Phone : +91 95 8290 7788 | Email : sales@itmonteur.net

Register & Request Quote | Submit Support Ticket

Home » Cyber Security » Major AI models not very transparent, says report, ET CIO

Major AI models not very transparent, says report, ET CIO

Major AI models not very transparent, says report, ET CIO


Artificial intelligence (AI) based foundations models such as Meta’s Llama 2 and OpenAI’s GPT-4 are low on transparency, according to a global report.

The Foundation Model Transparency Index created by a group of eight AI researchers from Stanford University, MIT Media Lab, and Princeton University, tracked 10 most popular AI models who disclosed information about their work and how people use their systems.

The report showed that “no major foundation model developer is close to providing adequate transparency, revealing a fundamental lack of transparency in the AI industry”.

Among the models it tested, Meta’s Llama 2 (54 per cent) scored the highest, closely followed by BloomZ (53 per cent) and then OpenAI’s GPT-4 (48 per cent).

Other models evaluated include Stability’s Stable Diffusion (47 per cent), Google’s PaLM 2 (40 per cent), Anthropic’s Claude (36 per cent), Command from Cohere (34 per cent), AI21 Labs’ Jurassic 2 (25 per cent), Inflection-1 (21 per cent) from Inflection, and Amazon’s Titan (12 per cent).

“While the societal impact of these models is rising, transparency is on the decline. If this trend continues, foundation models could become just as opaque as social media platforms and other previous technologies, replicating their failure modes,” the researchers said.

The report defined transparency based on 100 indicators for information about how the models are built, how they work, and how people use them. The researchers assessed these companies on the basis of their most salient and capable foundation model and systematically gathered information made publicly available by the developer as of September 15.

For each developer, two researchers scored the 100 indicators, assessing whether the developer satisfied the indicator on the basis of public information.

The initial scores were shared with leaders at each company, encouraging them to contest scores they disagreed with.

Although the mean score was just 37 per cent, 82 of the indicators were satisfied by at least one developer. This means that developers can significantly improve transparency by adopting best practices from their competitors, the researchers said.

“This provides a snapshot of transparency across the AI ecosystem. All developers have significant room for improvement that we will aim to track in the future versions of the Index,” the researchers noted.

  • Published On Oct 20, 2023 at 10:52 AM IST

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles


Scan to download App

Information Security - InfoSec - Cyber Security - Firewall Support Providers Company in India

 

What is Firewall? A Firewall is a network security device that monitors and filters incoming and outgoing network traffic based on an organization's previously established security policies. At its most basic, a firewall is essentially the barrier that sits between a private internal network and the public Internet.

 

Secure your network at the gateway against threats such as intrusions, Viruses, Spyware, Worms, Trojans, Adware, Keyloggers, Malicious Mobile Code (MMC), and other dangerous applications for total protection in a convenient, affordable subscription-based service. Modern threats like web-based malware attacks, targeted attacks, application-layer attacks, and more have had a significantly negative effect on the threat landscape. In fact, more than 80% of all new malware and intrusion attempts are exploiting weaknesses in applications, as opposed to weaknesses in networking components and services. Stateful firewalls with simple packet filtering capabilities were efficient blocking unwanted applications as most applications met the port-protocol expectations. Administrators could promptly prevent an unsafe application from being accessed by users by blocking the associated ports and protocols.

 

Firewall Firm is an IT Monteur Firewall Company provides Managed Firewall Support, Firewall providers , Firewall Security Service Provider, Network Security Services, Firewall Solutions India , New Delhi - India's capital territory , Mumbai - Bombay , Kolkata - Calcutta , Chennai - Madras , Bangaluru - Bangalore , Bhubaneswar, Ahmedabad, Hyderabad, Pune, Surat, Jaipur, Firewall Service Providers in India, Welcome to IT Monteur's Firewall Firm, India's No1 Managed Enterprise Network Security Firewall Support Provider Company in India, Firewall Firm Provider Complete range of Juniper Firewall Support , Cisco Firewall Support , Check Point Firewall Support , Palo Alto Firewall Support , FortiGate Firewall Support , Forcepoint Firewall Support , Sophos Firewall Support , WatchGuard Firewall Support , Baracuda Firewall Support , SonicWall Firewall Support , Gajshield Firewall Support , Seqrite Firewall Support , Firewall , Hardware Firewall , Software Firewall , Firewall India , Firewall , Network Firewall , Firewall Support , Firewall Monitoring , Firewall VPN , WAF Website Firewall , Firewall Security , Firewall India , Firewalls Support Provider in India , Firewall Support Services Provider Company in India

Sales Number : +91 95 8290 7788 | Support Number : +91 94 8585 7788
Sales Email : sales@itmonteur.net | Support Email : support@itmonteur.net

Register & Request Quote | Submit Support Ticket