AI Applications

Anyscale Unveils Anyscale Endpoints to Integrate Open-Source LLMs

Anyscale Unveils Anyscale Endpoints to Integrate Open-Source LLMs

San Francisco-based AI infrastructure company Anyscale has unveiled a new service, Anyscale Endpoints, at Ray Summit 2023. The service enables application developers to seamlessly integrate open-source Large Language Models (LLMs) into their projects using popular LLM APIs. Anyscale claims that Endpoints is significantly more cost-effective than proprietary solutions, with costs up to 10 times lower for specific tasks.

Traditionally, developers faced challenges such as complex infrastructure, high compute costs, and time-consuming model development when working with open-source LLMs. Anyscale's Endpoints simplifies this process by offering easy API access to powerful GPUs at a competitive price, allowing developers to harness open-source LLM capabilities without the traditional complexity.

Robert Nishihara, the Co-Founder and CEO of Anyscale, reportedly mentioned that historically, obstacles such as infrastructure complexity, compute resources, and cost had limited AI application developers’ use of open-source LLMs.

The demand for generative AI and high-quality LLM applications is rapidly rising, with the generative AI market projected to grow from $40 billion in 2022 to $1.3 trillion over the next decade, according to Bloomberg Intelligence. Gartner notes the advantages of open-source models, including customizability, better deployment control, enhanced privacy and security, and the ability to leverage collaborative development.

Anyscale offers Endpoints at a competitive rate of $1 per million tokens for state-of-the-art open-source LLMs, making LLM services more accessible to application developers. Additionally, Anyscale can quickly add new models, ensuring users have access to the latest innovations from the open-source community.

Robert Nishihara, the Co-Founder and CEO of Anyscale, emphasized the significance of endpoints, stating,

With seamless access via a simple API to powerful GPUs at a market-leading price, Endpoints lets developers take advantage of open-source LLMs without the complexity of traditional ML infrastructure. As AI innovation continues to accelerate, Endpoints enables developers to harvest the latest developments of the open-source community and stay focused on what matters—building the next generation of AI applications.

[Source: Globe Newswire]

Furthermore, Anyscale offers the option to run and use the Endpoints service within the customer's existing AWS or GCP cloud accounts, improving security and enabling the reuse of security controls and policies. Customers can also upgrade to the full Anyscale AI Application Platform for more customization and control over their data, models, and app architecture.

Anyscale Endpoints integrates seamlessly with popular Python and machine learning libraries and frameworks, facilitating various use cases across different cloud platforms as AI applications evolve.

Early users of Anyscale Endpoints have reported significant benefits, such as faster service deployment and cost advantages over proprietary alternatives. Anyscale's new service aims to empower developers to leverage open-source LLMs for their AI applications while reducing complexity and costs.

About Anyscale

Anyscale is a leading AI application platform founded by the creators of Ray, an open-source framework for scalable computing. Based in San Francisco, California, the company empowers developers of all skill levels to build, run, and scale AI applications with ease, from individual laptops to extensive data centers. Anyscale's mission is to simplify AI development by eliminating the need for distributed systems’ expertise, ensuring that every developer and team can succeed with AI. The company has gained traction in the industry, with organizations like Uber, OpenAI, Shopify, and Amazon using Ray for their machine learning platforms.


Other News
AI Applications

Planview Launches AI Copilot for Smarter Data-Driven Decision-Making

Planview | September 13, 2023

Planview, a leader in portfolio and value stream management, unveiled Planview Copilot, an advanced generative AI assistant, at its annual flagship customer event, Planview Accelerate. This innovative AI tool leverages comprehensive data sets to provide operational insights across portfolio management, value stream management, and agile planning and delivery, offering a conversational interface for data-driven strategic decision-making. Razat Gaurav, CEO of Planview, expressed his views on the potential of digital transformation initiatives. He emphasized that as organizations undertake an increasing number of these initiatives and utilize a wide range of tools to implement them, there is a significant opportunity to rethink how intelligent decisions can be made to expedite business results. He introduced Planview Copilot, which harnesses all pertinent data across project and product initiatives and delivers insights, decision support, and actions through a straightforward, conversational interface. He further highlighted this as a crucial progression in their journey from being a system of record to evolving into a system of insights for digital transformations. Planview Copilot gains access to a vast ecosystem of operational data, including exclusive strategy-to-delivery data, broader data from team tools, and an organization's historical initiative data. By integrating these data sources with Planview’s Flow Methodology and Agile Principles, Planview Copilot offers guidance and solutions throughout the strategy-to-execution journey. Richard Sonnenblick, Chief Data Scientist at Planview, stated that the future of connected work is built on a profound and insightful comprehension of how their customers deliver services, launch products, and successfully implement their strategies. He emphasized that this understanding is rooted in customer data. He explained that they utilize AI and machine learning techniques to analyze each customer's current and historical operational data in order to predict task completion, provide early warnings about tasks that may need course correction, and identify discrepancies between strategic objectives and ongoing activities. Also, he further added that through Planview Copilot, generative AI serves as the cherry on top, providing a user-friendly, conversational access point to these advanced AI and ML insights. Planview Copilot simplifies complex data insights using natural language processing, making them accessible to individuals and teams. It serves as an early warning system, alerting organizations to potential issues before they become costly or risky. This AI assistant is designed to empower executive leaders, portfolio managers, and teams by providing clear insights and recommendations. Dr. Mik Kersten, Planview CTO and Founder of The Flow Framework, emphasized, The launch of Planview Copilot marks the start of a step-function improvement in turning established organizations into digital innovators. [Source: Business Wire] This announcement follows Planview’s recent launch of Digital Products Insights, a convergence of portfolio management, agile planning, and value stream management powered by AI sentiment analysis. Planview Copilot is set to be available in Q4 2023, will reinforce Planview's commitment to proactive, data-driven decision-making for connected work. About Planview Planview, a software development company based in Austin, Texas, is on a mission to shape the future of connected work. The company is dedicated to helping organizations accelerate the achievement of their most important goals. Its platform, which underpins business and digital transformations for over 4,500 customers globally, including 59 Fortune 100 companies, is designed to accelerate the achievement of goals.

Read More

AI Tech

Forethought’s Autoflows: AI-Driven Revolution in Customer Support

Forethought | September 25, 2023

Forethought, a leader in generative AI for customer support, has introduced Autoflows, a groundbreaking autonomous resolution capability for SupportGPT. This innovation marks a significant step towards a more efficient, goal-oriented, AI-centric future in customer support. In the fast-evolving landscape of customer support, AI is positioned to revolutionize the way businesses interact with their clients. However, many large enterprises, despite claiming to be AI-first, still rely on outdated manual workflows rooted in the CRM era. These workflows consume hours of valuable time and often lead to subpar performance, dissatisfied customers, and delayed value realization. Forethought aims to transform this outdated approach into a system of intelligence, redefining what it means to be truly AI-first. Deon Nicholas, CEO and Co-Founder of Forethought, reportedly emphasized, Automation over the past decade has focused heavily on rules and tasks and building manual workflows. But the manual workflow is the Achilles heel of the AI-first future. [Source – Businesswire] Autoflows empower customer support leaders to define desired issue resolutions in plain, natural language, eliminating the need for complex decision trees or predefined rulesets. Leveraging AI, Autoflows accurately predicts user needs and determines efficient steps to achieve these desired outcomes. This efficiency allows support agents to redirect their focus towards more complex issues, transcending simplistic task-oriented processes. Autoflows promise significant benefits: Enhanced Customer Experience: Autoflows facilitate natural conversations with customers, employing generative AI models trained on real agent responses and CRM data. Improved Performance: These flows autonomously resolve customer issues and take actions in alignment with agent guidelines, brand preferences, and user prompts. Reduced Time to Value: Autoflows can be created in minutes using natural language, a stark contrast to the days it typically takes to construct intricate decision trees. Brent Pliskow, GM & VP of Customer Support at Upwork, expressed his appreciation for the innovation. He mentioned that they are constantly seeking to incorporate new generative AI capabilities into their customer support processes, with the goal of improving the customer experience and enhancing internal efficiency. He noted that, when they replaced specific manual workflows with Autoflows, they observed significant time savings compared to the traditional approach of building workflows. Additionally, he reported an increase of up to 27% in customer satisfaction in these particular use cases. About Forethought Founded in 2018, Forethought is a prominent generative AI company specializing in customer service automation. Its solutions seamlessly integrate generative AI powered by large language models (LLMs) to enhance support team efficiency. It offers instant case resolution, predictive case prioritization, and agent assistance, all within a single platform. With $90 million in venture capital funding and accolades like G2's Best Software Products for 2023, Forethought is a leader in the tech industry, headquartered in San Francisco, California.

Read More


New GenAI Software Testing Capabilities Enhance Productivity to Ensure Testing Completeness

PR Newswire | October 04, 2023

Parasoft, a global leading provider of automated software testing solutions, announces new advancements in its Continuous Quality Platform for functional solutions, which include Parasoft Virtualize, SOAtest, CTP, and DTP. The latest releases introduce capabilities including: GenAI integration for API testing Comprehensive microservices code coverage Web accessibility testing Powerful learning mode for creating and updating virtual assets These innovations are set to transform the landscape of software testing for enterprise application development and test teams. Learn more about Parasoft's latest releases at STARWEST. Visit Parasoft at booth #32 in person or virtually from October 4-5. Join the power panel discussion, "Winning AI Software Testing Strategies From Industry Leaders," on Wednesday, October 4, 2023, from 7:30 a.m. to 8:15 a.m. PDT. Attend Cox Automotive's session, "Drive Down Defects With Service Virtualization & Metrics That Matter," presented by Roya Montazeri, Senior Director for the Technical & QA teams, on Wednesday, October 4, 2023, at 2:45 p.m. PDT. Parasoft's new features address the challenges faced by enterprise application development and test teams and their management in ensuring the reliability of their software. GenAI integration for API testing with Parasoft SOAtest Automate advanced test case generation based on API definitions while ensuring relevance and accuracy. Seamlessly integrate GenAI using OpenAI or Azure OpenAI models for efficient test scenario generation. Comprehensive code coverage and test impact analysis for microservices testing with Parasoft CTP and DTP Enhance visibility of application coverage across multiple distributed microservices addressing the challenge of end-to-end testing coverage. Use test impact analysis to identify which end-to-end tests should be executed to validate downstream microservice changes in your AUT. Ability to reuse existing SOAtest web functional tests for web accessibility testing Quickly and simply satisfy web accessibility requirements by reusing existing SOAtest web UI tests. Accelerate compliance with Web Content Accessibility Guidelines (WCAG) and integrate accessibility testing into your automation pipeline. Learning mode for service virtualization in Parasoft Virtualize Easily create always-up-to-date virtual assets for running regression tests and overcome challenges stemming from live endpoint unavailability or instability. Dynamically learn runtime traffic for realistic service simulation—ideal for introducing service virtualization to new teams. With the latest Parasoft Virtualize release, we're looking forward to using learning mode. This new feature will allow us to create service simulations faster, and they'll always be up to date, said a valued Parasoft customer of a leading global financial services company. About Parasoft Parasoft helps organizations continuously deliver quality software with its market-proven, integrated suite of automated software testing tools. Supporting the embedded, enterprise, and IoT markets, Parasoft's technologies reduce the time, effort, and cost of delivering secure, reliable, and compliant software by integrating everything from deep code analysis and unit testing to web UI and API testing, plus service virtualization and complete code coverage, into the delivery pipeline. Bringing all this together, Parasoft's award winning reporting and analytics dashboard delivers a centralized view of quality enabling organizations to deliver with confidence and succeed in today's most strategic ecosystems and development initiatives — security, safety-critical, Agile, DevOps, and continuous testing.

Read More

AI Applications

IntelePeer's AI Call Summary Dashboard Elevates Customer Interactions

IntelePeer | September 15, 2023

IntelePeer, a prominent AI-driven communications automation solutions provider, introduces a new addition to its SmartFlows platform, the Call Summary Dashboard. This innovative dashboard, equipped with AI and automation tools, empowers businesses to optimize omnichannel communication workflows, monitor real-time ROI, and identify cost-saving opportunities. Existing IntelePeer customers can access the Call Summary Dashboard at no extra cost, enabling them to create advanced hyper-automation omnichannel experiences without prolonged development cycles. Frank Fawzi, the CEO of IntelePeer, emphasized the company's dedication to addressing the needs of enterprises for high-quality automated customer interactions. He stated that AI had become a crucial element for businesses, leading to reduced labor costs and improved competitiveness. Fawzi noted that IntelePeer's most recent analytics engine and dashboard demonstrated how AI enhances the customer experience by guaranteeing consistent and precise responses to queries while eliminating call holds. He also mentioned that when the dashboard is put into action, it discloses the real-time count of fully automated customer interactions, resulting in a significant reduction in hold times and a substantial return on investment. This, in turn, saves businesses thousands through increased automation. The Call Summary Dashboard offers precise data on contained calls automated by IntelePeer's Smart product suite. Customers can assess the savings achieved by utilizing IntelePeer's AI-powered virtual SmartAgents instead of live agents. The dashboard also facilitates the creation of "what if" scenarios based on live traffic, demonstrating additional potential savings through increased automation and self-service capabilities over a specified timeframe. Fawzi highlighted the benefits, saying, With rich analytics at their fingertips, businesses can enhance operational efficiencies, improve customer experience, and make data-driven decisions. Companies harnessing generative AI are gaining an edge, and as AI continues to evolve, IntelePeer remains committed to assisting customers in harnessing this technology to meet evolving consumer needs. [Source: Businesswire] IntelePeer's SmartFlows leverage leading AI platforms like Azure's OpenAI for Generative AI, IBM Watson Assistant, Amazon Lex, and Google Dialog Flow for Conversational AI. Users can create communication-enabled workflows that seamlessly integrate with existing processes and develop intelligent AI voice and messaging bots based on CRM data interactions and other data sources to enhance CX. Key SmartFlows features include: Massively scalable simultaneous call and messaging capabilities Built-in Natural Language Processing and Generation Automated and intelligent routing Easy integration with CRM and other business applications Audio library Pre-built templates About IntelePeer Founded in 2003 and headquartered in Dania Beach, Florida, IntelePeer is a leading software development firm specializing in AI-driven omnichannel communication solutions. Its Communications Platform as a Service (CPaaS) optimizes customer experiences, reduces costs, and streamlines operations through user-friendly, integrated software. With a robust online presence, IntelePeer continues to innovate in cloud-based communications, offering services such as cloud communications, cloud calling, cloud contact centers, and more.

Read More