https://www.digiteex.com Digitex Solutions Fri, 31 Jan 2025 19:21:05 +0000 en-US hourly 1 224764844 https://www.digiteex.com/deepseeks-safety-guardrails-failed-every-test-researchers-threw-at-its-ai-chatbot/ https://www.digiteex.com/deepseeks-safety-guardrails-failed-every-test-researchers-threw-at-its-ai-chatbot/#respond Fri, 31 Jan 2025 19:21:01 +0000 https://www.digiteex.com/deepseeks-safety-guardrails-failed-every-test-researchers-threw-at-its-ai-chatbot/ “Jailbreaks persist simply because eliminating them entirely is nearly impossible—just like buffer overflow vulnerabilities in software (which have existed for over 40 years) or SQL injection flaws in web applications (which have plagued security teams for more than two decades),” Alex Polyakov, the CEO of security firm Adversa AI, told WIRED in an email.Cisco’s Sampath argues that as companies use more types of AI in their applications, the risks are amplified. “It starts to become a big deal when you start putting these models into important complex systems and those jailbreaks suddenly result in downstream things that increases liability, increases business risk, increases all kinds of issues for enterprises,” Sampath says.The Cisco researchers drew their 50 randomly selected prompts to test DeepSeek’s R1 from a well-known library of standardized evaluation prompts known as HarmBench. They tested prompts from six HarmBench categories, including general harm, cybercrime, misinformation, and illegal activities. They probed the model running locally on machines rather than through DeepSeek’s website or app, which send data to China.Beyond this, the researchers say they have also seen some potentially concerning results from testing R1 with more involved, non-linguistic attacks using things like Cyrillic characters and tailored scripts to attempt to achieve code execution. But for their initial tests, Sampath says, his team wanted to focus on findings that stemmed from a generally recognized benchmark.Cisco also included comparisons of R1’s performance against HarmBench prompts with the performance of other models. And some, like Meta’s Llama 3.1, faltered almost as severely as DeepSeek’s R1. But Sampath emphasizes that DeepSeek’s R1 is a specific reasoning model, which takes longer to generate answers but pulls upon more complex processes to try to produce better results. Therefore, Sampath argues, the best comparison is with OpenAI’s o1 reasoning model, which fared the best of all models tested. (Meta did not immediately respond to a request for comment).Polyakov, from Adversa AI, explains that DeepSeek appears to detect and reject some well-known jailbreak attacks, saying that “it seems that these responses are often just copied from OpenAI’s dataset.” However, Polyakov says that in his company’s tests of four different types of jailbreaks—from linguistic ones to code-based tricks—DeepSeek’s restrictions could easily be bypassed.“Every single method worked flawlessly,” Polyakov says. “What’s even more alarming is that these aren’t novel ‘zero-day’ jailbreaks—many have been publicly known for years,” he says, claiming he saw the model go into more depth with some instructions around psychedelics than he had seen any other model create.“DeepSeek is just another example of how every model can be broken—it’s just a matter of how much effort you put in. Some attacks might get patched, but the attack surface is infinite,” Polyakov adds. “If you’re not continuously red-teaming your AI, you’re already compromised.”


Source link

]]> https://www.digiteex.com/deepseeks-safety-guardrails-failed-every-test-researchers-threw-at-its-ai-chatbot/feed/ 0 4609 https://www.digiteex.com/india-to-develop-own-generative-ai-model-ashwini-vaishnaw/ https://www.digiteex.com/india-to-develop-own-generative-ai-model-ashwini-vaishnaw/#respond Thu, 30 Jan 2025 07:19:38 +0000 https://www.digiteex.com/india-to-develop-own-generative-ai-model-ashwini-vaishnaw/ Amid a tug of war on artificial intelligence (AI) supremacy between the US and China, union minister Ashwini Vaishnaw has announced that India will develop its own generative AI model. The initiative was announced by the minister at the Utkarsh Odisha Conclave. He said that the model will be powered by the India AI Compute Facility, which has secured 19,000 GPUs to develop a large language model (LLM) designed specifically for the country. Out of these, 15,000 are high-end. With this, the government has overreached its target of 10,000 GPUs.At least six developers have been identified who can roll this out in 8-10 months. Foundation models are AI models trained on vast repositories of data, which can be used as the base for other applications.”Cost of compute — GPU access per hour — after the 40% govt incentive will be less than a dollar in India, the lowest in the world,” the minister said in a press conference regarding the India AI Mission.Artificial Intelligence(AI)Java Programming with ChatGPT: Learn using Generative AIBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program Artificial Intelligence(AI)Basics of Generative AI: Unveiling Tomorrows InnovationsBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program Artificial Intelligence(AI)Generative AI for Dynamic Java Web Applications with ChatGPTBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program Artificial Intelligence(AI)Mastering C++ Fundamentals with Generative AI: A Hands-OnBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program Artificial Intelligence(AI)Master in Python Language Quickly Using the ChatGPT Open AIBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program MarketingPerformance Marketing for eCommerce BrandsBy – Zafer Mukeri, Founder- Inara MarketersView Program Office ProductivityZero to Hero in Microsoft Excel: Complete Excel guide 2024By – Metla Sudha Sekhar, IT Specialist and DeveloperView Program FinanceA2Z Of MoneyBy – elearnmarkets, Financial Education by StockEdgeView Program MarketingModern Marketing Masterclass by Seth GodinBy – Seth Godin, Former dot com Business Executive and Best Selling AuthorView Program AstrologyVastu Shastra CourseBy – Sachenkumar Rai, Vastu ShashtriView Program StrategySuccession Planning MasterclassBy – Nigel Penny, Global Strategy Advisor: NSP Strategy Facilitation Ltd.View Program Data ScienceSQL for Data Science along with Data Analytics and Data VisualizationBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program Artificial Intelligence(AI)AI and Analytics based Business StrategyBy – Tanusree De, Managing Director- Accenture Technology Lead, Trustworthy AI Center of Excellence: ATCIView Program Web DevelopmentA Comprehensive ASP.NET Core MVC 6 Project Guide for 2024By – Metla Sudha Sekhar, IT Specialist and DeveloperView Program MarketingDigital Marketing Masterclass by Pam MooreBy – Pam Moore, Digital Transformation and Social Media ExpertView Program Artificial Intelligence(AI)AI-Powered Python Mastery with Tabnine: Boost Your Coding SkillsBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program Office ProductivityMastering Microsoft Office: Word, Excel, PowerPoint, and 365By – Metla Sudha Sekhar, IT Specialist and DeveloperView Program MarketingDigital marketing – WordPress Website DevelopmentBy – Shraddha Somani, Digital Marketing Trainer, Consultant, Strategiest and Subject Matter expertView Program Office ProductivityMastering Google Sheets: Unleash the Power of Excel and Advance AnalysisBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program Web DevelopmentMastering Full Stack Development: From Frontend to Backend ExcellenceBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program FinanceFinancial Literacy i.e Lets Crack the Billionaire CodeBy – CA Rahul Gupta, CA with 10+ years of experience and Accounting EducatorView Program Data ScienceSQL Server Bootcamp 2024: Transform from Beginner to ProBy – Metla Sudha Sekhar, IT Specialist and DeveloperView Program ET was the first to report on January 23 that India wants to build its own foundational model.Discover the stories of your interestThe Centre’s move follows the US government restricting export of AI compute infrastructure and limiting use of language models that are currently dominated by American technology firms. After the model is launched, this will place India in a select group of nations including the US and China where local companies are building prominent models.


Source link

]]> https://www.digiteex.com/india-to-develop-own-generative-ai-model-ashwini-vaishnaw/feed/ 0 4518