Eisspeedway

Open-source artificial intelligence

Open-source artificial intelligence is an AI system that is freely available to use, study, modify, and share.[1] These attributes extend to each of the system's components, including datasets, code, and model parameters, promoting a collaborative and transparent approach to AI development.[1]

Free and open-source software (FOSS) licenses, such as the Apache License, MIT License, and GNU General Public License, outline the terms under which open-source artificial intelligence can be accessed, modified, and redistributed.[2]

The open-source model provides widespread access to new AI technologies, allowing individuals and organizations of all sizes to participate in AI research and development.[3][4] This approach supports collaboration and allows for shared advancements within the field of artificial intelligence.[3][4]

In contrast, closed-source artificial intelligence is proprietary, restricting access to the source code and internal components.[3] Only the owning company or organization can modify or distribute a closed-source artificial intelligence system, prioritizing control and protection of intellectual property over external contributions and transparency.[3][5][6]

Companies often develop closed products in an attempt to keep a competitive advantage in the marketplace.[6] However, some experts suggest that open-source AI tools may have a development advantage over closed-source products and have the potential to overtake them in the marketplace.[6][4]

Popular open-source artificial intelligence project categories include large language models, machine translation tools, and chatbots.[7]

For software developers to produce open-source artificial intelligence (AI) resources, they must trust the various other open-source software components they use in its development.[8][9]

Open-source AI software has been speculated to have potentially increased risk compared to closed-source AI as bad actors may remove safety protocols of public models as they wish.[4] Similarly, closed-source AI has also been speculated to have an increased risk compared to open-source AI due to issues of dependence, privacy, opaque algorithms, corporate control and limited availability while potentially slowing beneficial innovation.[10][11][12] There also is a debate about the openness of AI systems as openness is differentiated[13] – an article in Nature suggests that some systems described as open, such as Meta's LLaMA-3, "offer little more than an API or the ability to download a model subject to distinctly non-open use restrictions". Such software has been criticized as "openwashing"[14] systems that are better understood as closed.[11] There are some works and frameworks that assess the openness of AI systems[15][13] as well as a controversial new definition by the Open Source Initiative about what constitutes open source AI.[16][17][18]

History

The history of open-source artificial intelligence (AI) is intertwined with both the development of AI technologies and the growth of the open-source software movement.[19] Open-source AI has evolved significantly over the past few decades, with contributions from various academic institutions, research labs, tech companies, and independent developers.[20] This section explores the major milestones in the development of open-source AI, from its early days to its current state.

Early development of AI and open-source software

The concept of AI dates back to the mid-20th century, when computer scientists like Alan Turing and John McCarthy laid the groundwork for modern AI theories and algorithms.[21] Early AI research focused on developing symbolic reasoning systems and rule-based expert systems.[22] During this period, the idea of open-source software was beginning to take shape, with pioneers like Richard Stallman advocating for free software as a means to promote collaboration and innovation in programming.[23]

The Free Software Foundation, founded in 1985 by Stallman, was one of the first major organizations to promote the idea of software that could be freely used, modified, and distributed. The ideas from this movement eventually influenced the development of open-source AI, as more developers began to see the potential benefits of open collaboration in software creation, including AI models and algorithms.[24][25]

Emergence of open-source AI (1990s-2000s)

In the 1990s, open-source software began to gain more traction as the internet facilitated collaboration across geographical boundaries.[26] The rise of machine learning and statistical methods also led to the development of more practical AI tools. However, it wasn't until the early 2000s that open-source AI began to take off, with the release of foundational libraries and frameworks that were available for anyone to use and contribute to.[27]

One of the early open-source AI frameworks was Scikit-learn, released in 2007.[28] Scikit-learn became one of the most widely used libraries for machine learning due to its ease of use and robust functionality, providing implementations of common algorithms like regression, classification, and clustering.[29][30] Around the same time, other open-source machine learning libraries such as OpenCV (2000), Torch (2002), and Theano (2007) were developed by tech companies and research labs, further cementing the growth of open-source AI.

Rise of open-source AI models and frameworks (2010s)

The 2010s marked a significant shift in the development of AI, driven by the advent of deep learning and neural networks.[31] Open-source deep learning frameworks such as TensorFlow (developed by Google Brain) and PyTorch (developed by Facebook's AI Research Lab) revolutionized the AI landscape by making complex deep learning models more accessible.[32][33] These frameworks allowed researchers and developers to build and train sophisticated neural networks for tasks like image recognition, natural language processing (NLP), and autonomous driving.[34][35]

During this time, AI models like Google's BERT (2018) for natural language processing and OpenAI's GPT series (2018–present) for text generation also became widely available in open-source form. These models demonstrated the potential for AI to revolutionize industries by improving understanding and generation of human language, sparking further interest in open-source AI development.

Key milestones in open-source AI (2020s–Present)

Companies and models

The 2020s saw the continued growth and maturation of open-source AI. Companies and research organizations began to release large-scale pre-trained models to the public, which led to a boom in both commercial and academic applications of AI. Notably, Hugging Face, a company focused on NLP, became a hub for the development and distribution of state-of-the-art AI models, including open-source versions of transformers like GPT-2, GPT-3, and BERT.[36]

With the announcement of GPT-2, OpenAI originally planned to keep the source code of their models private citing concerns about malicious applications.[37] After OpenAI faced public backlash, however, it released the source code for GPT-2 to GitHub three months after its release.[37] OpenAI has not publicly released the source code or pretrained weights for the GPT-3 or GPT-4 models, though their functionalities can be integrated by developers through the OpenAI API.[38][39]

The rise of large language models (LLMs) and generative AI, such as OpenAI's GPT-3 (2020), further propelled the demand for open-source AI frameworks.[40][41] These models have been used in a variety of applications, including chatbots, content creation, and code generation, demonstrating the broad capabilities of AI systems.[42] In addition, major tech companies like Meta and Google made strides in releasing open-source AI models, with Meta's LLaMA series and Google's T5 offering powerful, accessible AI models that were free for research purposes.

The LF AI & Data Foundation, a project under the Linux Foundation, has significantly influenced the open-source AI landscape by fostering collaboration and innovation, and supporting open-source projects.[43] By providing a neutral platform, LF AI & Data unites developers, researchers, and organizations to build cutting-edge AI and data solutions, addressing critical technical challenges and promoting ethical AI development.[44]

As of October 2024, the foundation comprised 77 member companies from North America, Europe, and Asia, and hosted 67 open-source software (OSS) projects contributed by a diverse array of organizations, including silicon valley giants such as Nvidia, Amazon, Intel, and Microsoft.[45] Other large conglomerates like Alibaba, TikTok, AT&T, and IBM have also contributed.[45] Research organizations such as NYU, University of Michigan AI labs, Columbia University, Penn State are also associate members of the LF AI & Data Foundation.[45]

In September 2022, the PyTorch Foundation was established to oversee the widely used PyTorch deep learning framework, which was donated by Meta.[46] The foundation's mission is to drive the adoption of AI tools by fostering and sustaining an ecosystem of open-source, vendor-neutral projects integrated with PyTorch, and to democratize access to state-of-the-art tools, libraries, and other components, making these innovations accessible to everyone.[47]

The PyTorch Foundation also separates business and technical governance, with the PyTorch project maintaining its technical governance structure, while the foundation handles funding, hosting expenses, events, and management of assets such as the project's website, GitHub repository, and social media accounts, ensuring open community governance.[47] Upon its inception, the foundation formed a governing board comprising representatives from its initial members: AMD, Amazon Web Services, Google Cloud, Hugging Face, IBM, Intel, Meta, Microsoft, and NVIDIA.[47]

In 2024, Meta released a collection of large AI models, including Llama 3.1 405B, comparable to the most advanced closed-source models.[48] The company claimed its approach to AI would be open-source, detracting from other major tech companies.[48] Controversially, Meta has been criticized for not being truly open-source.[49]

Ethics

In parallel with the development of AI models, there has been growing interest in ensuring ethical standards in open-source AI development.[50][51] This includes addressing concerns such as bias, privacy, and the potential for misuse of AI systems.[50][51] As a result, frameworks for responsible AI development and the creation of guidelines for documenting ethical considerations, such as the Model Card concept introduced by Google, have gained popularity, though studies show the continued need for their adoption to avoid unintended negative outcomes.[52][53][54]

Applications

Machine learning

See also: Scikit-learn, TensorFlow, and PyTorch

Open-source artificial intelligence has brought widespread accessibility to machine learning (ML) tools, enabling developers to implement and experiment with ML models across various industries. Sci-kit Learn, Tensorflow, and PyTorch are three of the most widely used open-source ML libraries, each contributing unique capabilities to the field.[55] Sci-kit Learn is known for its robust toolkit, offering accessible functions for classification, regression, clustering, and dimensionality reduction.[56] This library simplifies the ML pipeline from data preprocessing to model evaluation, making it ideal for users with varying levels of expertise.[56] Tensorflow, initially developed by Google, supports large-scale ML models, especially in production environments requiring scalability, such as healthcare, finance, and retail.[57] PyTorch, favored for its flexibility and ease of use, has been particularly popular in research and academia, supporting everything from basic ML models to advanced deep learning applications, and it is now widely used by the industry, too.[58]

Natural Language Processing

Large language models

Further information: Large language model

Open-source AI has played a crucial role in developing and adopting of Large Language Models (LLMs), transforming text generation and comprehension capabilities. While proprietary models like OpenAI's GPT series have redefined what is possible in applications such as interactive dialogue systems and automated content creation, fully open-source models have also made significant strides. Google's BERT, for instance, is an open-source model widely used for tasks like entity recognition and language translation, establishing itself as a versatile tool in NLP.[59] Meta's LLAMA (Large Language Model Meta AI) represents another breakthrough in open-source LLMs, offering a platform specifically designed to support research and domain-specific applications.[60] These open-source LLMs have democratized access to advanced language technologies, enabling developers to create applications such as personalized assistants, legal document analysis, and educational tools without relying on proprietary systems.[61]

Machine Translation

Further information: Neural machine translation

Open-source machine translation models have paved the way for multilingual support in applications across industries. Hugging Face's MarianMT is a prominent example, providing support for a wide range of language pairs, becoming a valuable tool for translation and global communication.[62] Another notable model, OpenNMT, offers a comprehensive toolkit for building high-quality, customized translation models, which are used in both academic research and industries.[63] Alongside these open-source models, open-source datasets such as the WMT (Workshop on Machine Translation) datasets, Europarl Corpus, and OPUS have played a critical role in advancing machine translation technology.[64][65] These datasets provide diverse, high-quality parallel text corpora that enable developers to train and fine-tune models for specific languages and domains.[64]

Text-to-image models

Further information: Text-to-image model

Computer vision models

Further information: Computer vision

Open-source AI has led to considerable advances in the field of computer vision, with libraries such as OpenCV (Open Computer Vision Library) playing a pivotal role in the democratization of powerful image processing and recognition capabilities.[66] OpenCV provides a comprehensive set of functions that can support real-time computer vision applications, such as image recognition, motion tracking, and facial detection.[67] Originally developed by Intel, OpenCV has become one of the most popular libraries for computer vision due to its versatility and extensive community support.[66][67] The library includes a range of pre-trained models and utilities for handling common tasks, making OpenCV into a valuable resource for both beginners and experts of the field. Beyond OpenCV, other open-source computer vision models like YOLO (You Only Look Once) and Detectron2 offer specialized frameworks for object detection, classification, and segmentation, contributing to advancements in applications like security, autonomous vehicles, and medical imaging.[68][69]

Unlike the previous generations of Computer Vision models, which process image data through convolutional layers, newer generations of computer vision models, referred to as Vision Transformer (ViT), rely on attention mechanisms similar to those found in the area of natural language processing.[70] ViT models break down an image into smaller patches and apply self-attention to identify which areas of the image are most relevant, effectively capturing long-range dependencies within the data.[70] This shift from convolutional operations to attention mechanisms enables ViT models to achieve state-of-the-art accuracy in image classification and other tasks, pushing the boundaries of computer vision applications.[71]

Robotics

Main article: Open-source robotics

Open-source artificial intelligence has made a notable impact in robotics by providing a flexible, scalable development environment for both academia and industry.[72] The Robot Operating System (ROS) stands out as a leading open-source framework, offering tools, libraries, and standards essential for building robotics applications.[73] ROS simplifies the development process, allowing developers to work across different hardware platforms and robotic architectures.[72] Furthermore, Gazebo, an open-source robotic simulation software often paired with ROS, enables developers to test and refine their robotic systems in a virtual environment before real-world deployment.[74]

Healthcare

Further information: Artificial intelligence in healthcare

In the healthcare industry, open-source AI has revolutionized diagnostics, patient care, and personalized treatment options.[75] Open-source libraries like Tensorflow and PyTorch have been applied extensively in medical imaging for tasks such as tumor detection, improving the speed and accuracy of diagnostic processes.[76][75] Additionally, OpenChem, an open-source library specifically geared toward chemistry and biology applications, enables the development of predictive models for drug discovery, helping researchers identify potential compounds for treatment.[77] NLP models, adapted for analyzing electronic health records (EHRs), have also become instrumental in healthcare.[78] By summarizing patient data, detecting patterns, and flagging potential issues, open-source AI has enhanced clinical decision-making and improved patient outcomes, demonstrating the transformative power of AI in medicine.[78]

Military

See also: Artificial intelligence arms race

Open-source AI has become a critical component in military applications, highlighting both its potential and its risks. Meta's Llama models, initially restricted from military use, were adopted by U.S. defense contractors like Lockheed Martin and Oracle after unauthorized adaptations by Chinese researchers affiliated with the People's Liberation Army (PLA) came to light.[79][80] Chinese researchers used an earlier version of Llama to develop tools like ChatBIT, optimized for military intelligence and decision-making, prompting Meta to expand its partnerships with U.S. contractors to ensure the technology could be used strategically for national security.[80] These applications now include logistics, maintenance, and cybersecurity enhancements.[80]

Benefits

The open-source movement has influenced the development of artificial intelligence, enabling the widespread adoption and collaboration that are key to its rapid evolution. By making AI tools freely available, open-source platforms empower individuals, research institutions, and companies to contribute, adapt, and innovate on top of existing technologies.

Democratizing access

Open-source AI democratizes access to cutting-edge tools, lowering entry barriers for individuals and smaller organizations that may lack resources.[81] By making these technologies freely available, open-source AI allows developers to innovate and create AI solutions that might have been otherwise inaccessible due to financial constraints, enabling independent developers and researchers, smaller organizations, and startups to utilize advanced AI models without the financial burden of proprietary software licenses.[81] This affordability encourages innovation in niche or specialized applications, as developers can modify existing models to meet unique needs.[81][82]

Collaboration and faster advancements

By sharing code, data, and research findings, open-source AI enables collective problem-solving and innovation.[82] Large-scale collaborations, such as those seen in the development of frameworks like TensorFlow and PyTorch, have accelerated advancements in machine learning (ML) and deep learning.[31]

The open-source nature of these platforms also facilitates rapid iteration and improvement, as contributors from across the globe can propose modifications and enhancements to existing tools.[31][24] Beyond enhancements directly within ML and deep learning, this collaboration can lead to faster advancements in the products of AI, as shared knowledge and expertise are pooled together.[24][82]

Equitable development

The openness of the development process encourages diverse contributions, making it possible for underrepresented groups to shape the future of AI. This inclusivity not only fosters a more equitable development environment but also helps to address biases that might otherwise be overlooked by larger, profit-driven corporations.[83] With contributions from a broad spectrum of perspectives, open-source AI has the potential to create more fair, accountable, and impactful technologies that better serve global communities.[83]

Transparency and obscurity

A video about the importance of transparency of AI in medicine

One key benefit of open-source AI is the increased transparency it offers compared to closed-source alternatives. With open-source models, the underlying algorithms and code are accessible for inspection, which promotes accountability and helps developers understand how a model reaches its conclusions.[15] Additionally, open-weight models such as GPT-3, LLaMA, and Stable Diffusion allow developers to directly access model parameters, potentially facilitating the reduced bias and increased fairness in their applications.[15] This transparency can help create systems with human-readable outputs, or "explainable AI", which is a growingly key concern, especially in high-stakes applications such as healthcare, criminal justice, and finance, where the consequences of decisions made by AI systems can be significant (though may also pose certain risks, as mentioned in the Concerns section).[84]

Privacy and independence

A Nature editorial suggests medical care could become dependent on AI models that could be taken down at any time, are difficult to evaluate, and may threaten patient privacy.[10] Its authors propose that health-care institutions, academic researchers, clinicians, patients and technology companies worldwide should collaborate to build open-source models for health care of which the underlying code and base models are easily accessible and can be fine-tuned freely with own data sets.[10]

Concerns

In parallel with its benefits, open-source AI brings with it important ethical and social implications, as well as quality and security concerns.

Quality and security

Open-sourced development of AI has been criticized by researchers for additional quality and security concerns beyond general concerns regarding AI safety.

Current open-source models underperform closed-source models on most tasks, but open-source models are improving faster to close the gap.[85]

Open-source development of models has been deemed to have theoretical risks. Once a model is public, it cannot be rolled back or updated if serious security issues are detected.[4] For example, Open-source AI may allow bioterrorism groups like Aum Shinrikyo to remove fine-tuning and other safeguards of AI models to get AI to help develop more devastating terrorist schemes.[86] The main barrier to developing real-world terrorist schemes lies in stringent restrictions on necessary materials and equipment.[4] Furthermore, the rapid pace of AI advancement makes it less appealing to use older models, which are more vulnerable to attacks but also less capable.[4]

In July 2024, the United States released a presidential report saying it did not find sufficient evidence to restrict revealing model weights.[87]

Equity, social, and ethical implications

There have been numerous cases of artificial intelligence leading to unintentionally biased products. Some notable examples include AI software predicting higher risk of future crime and recidivism for African-Americans when compared to white individuals, voice recognition models performing worse for non-native speakers, and facial-recognition models performing worse for women and darker-skinned individuals.[88][83][89]

Researchers have also criticized open-source artificial intelligence for existing security and ethical concerns. An analysis of over 100,000 open-source models on Hugging Face and GitHub using code vulnerability scanners like Bandit, FlawFinder, and Semgrep found that over 30% of models have high-severity vulnerabilities.[90] Furthermore, closed models typically have fewer safety risks than open-sourced models.[4] The freedom to augment open-source models has led to developers releasing models without ethical guidelines, such as GPT4-Chan.[4]

With AI systems increasingly employed into critical frameworks of society such as law enforcement and healthcare, there is a growing focus on preventing biased and unethical outcomes through guidelines, development frameworks, and regulations. Open-source AI has the potential to both exacerbate and mitigate bias, fairness, and equity, depending on its use.

Improving AI models

While AI suffers from a lack of centralized guidelines for ethical development, frameworks for addressing the concerns regarding AI systems are emerging. These frameworks, often products of independent studies and interdisciplinary collaborations, are frequently adapted and shared across platforms like GitHub and Hugging Face to encourage community-driven enhancements.

Common development malpractices

Data quality

There are numerous systemic problems that may contribute to inequitable and biased AI outcomes, stemming from causes such as biased data, flaws in model creation, and failing to recognize or plan for the possibility of these outcomes.[91] As highlighted in research, poor data quality—such as the underrepresentation of specific demographic groups in datasets—and biases introduced during data curation lead to skewed model outputs.[89]

A study of open-source AI projects revealed a failure to scrutinize for data quality, with less than 28% of projects including data quality concerns in their documentation.[91] This study also showed a broader concern that developers do not place enough emphasis on the ethical implications of their models, and even when developers do take ethical implications into consideration, these considerations overemphasize certain metrics (behavior of models) and overlook others (data quality and risk-mitigation steps).[91] These issues are compounded by AI documentation practices, which often lack actionable guidance and only briefly outline ethical risks without providing concrete solutions.

Transparency and "black boxes"

Another key flaw notable in many of the systems shown to have biased outcomes is their lack of transparency.[89] Many open-source AI models operate as "black boxes", where their decision-making process is not easily understood, even by their creators.[89] This lack of interpretability can hinder accountability, making it difficult to identify why a model made a particular decision or to ensure it operates fairly across diverse groups.[89]

Furthermore, when AI models are closed-source (proprietary), this can facilitate biased systems slipping through the cracks, as was the case for numerous widely adopted facial recognition systems.[89] These hidden biases can persist when those proprietary systems fail to publicize anything about the decision process which could help reveal those biases, such as confidence intervals for decisions made by AI.[89] Especially for systems like those used in healthcare, being able to see and understand systems' reasoning or getting "an [accurate] explanation" of how an answer was obtained is "crucial for ensuring trust and transparency".[92]

Frameworks for improvement

Efforts to counteract these challenges have resulted in the creation of structured documentation frameworks that guide the ethical development and deployment of AI:

  • Model Cards: Introduced in a Google research paper, these documents provide transparency about an AI model's intended use, limitations, and performance metrics across different demographics.[93][53] They serve as a standardized tool to highlight ethical considerations and facilitate informed usage.[93][53] Though still relatively new, Google believes this framework will play a crucial role in helping increase AI transparency.[53]
  • Measurement Modeling: This method combines qualitative and quantitative methods through a social sciences lens, providing a framework that helps developers check if an AI system is accurately measuring what it claims to measure. The framework focuses on two key concepts, examining test-retest reliability ("construct reliability") and whether a model measures what it aims to model ("construct validity"). Through these concepts, this model can help developers break down abstract ideas which can't be directly measured (like socioeconomic status) into specific, measurable components while checking for errors or mismatches that could lead to bias. By making these assumptions clear, this framework helps create AI systems that are more fair and reliable.[88]
  • Datasheets for Datasets: This framework emphasizes documenting the motivation, composition, collection process, and recommended use cases of datasets.[94] By detailing the dataset's lifecycle, datasheets enable users to assess its appropriateness and limitations.[94]
  • Model Openness Framework: This emerging approach includes principles for transparent AI development, focusing on the accessibility of both models and datasets to enable auditing and accountability.[95]

As AI use grows, increasing AI transparency and reducing model biases has become increasingly emphasized as a concern.[84] These frameworks can help empower developers and stakeholders to identify and mitigate bias, fostering fairness and inclusivity in AI systems.[88][84] Using these frameworks can help the open-source community create tools that are not only innovative but also equitable and ethical.

See also

References

  1. ^ a b "The Open Source AI Definition – 1.0". Open Source Initiative. Retrieved 2024-11-14.
  2. ^ "Licenses". Open Source Initiative. Retrieved 2024-11-14.
  3. ^ a b c d Hassri, Myftahuddin Hazmi; Man, Mustafa (2023-12-07). "The Impact of Open-Source Software on Artificial Intelligence". Journal of Mathematical Sciences and Informatics. 3 (2). doi:10.46754/jmsi.2023.12.006. ISSN 2948-3697.
  4. ^ a b c d e f g h i Eiras, Francisco; Petrov, Aleksandar; Vidgen, Bertie; Schroeder, Christian; Pizzati, Fabio; Elkins, Katherine; Mukhopadhyay, Supratik; Bibi, Adel; Purewal, Aaron (2024-05-29), Risks and Opportunities of Open-Source Generative AI, arXiv:2405.08597
  5. ^ Isaac, Mike (2024-05-29). "What to Know About the Open Versus Closed Software Debate". The New York Times. Retrieved 2024-11-13.
  6. ^ a b c Solaiman, Irene (May 24, 2023). "Generative AI Systems Aren't Just Open or Closed Source". Wired.
  7. ^ Castelvecchi, Davide (29 June 2023). "Open-source AI chatbots are booming — what does this mean for researchers?". Nature. 618 (7967): 891–892. Bibcode:2023Natur.618..891C. doi:10.1038/d41586-023-01970-6. PMID 37340135.
  8. ^ Thummadi, Babu Veeresh (2021). "Artificial Intelligence (AI) Capabilities, Trust and Open Source Software Team Performance". In Denis Dennehy; Anastasia Griva; Nancy Pouloudi; Yogesh K. Dwivedi; Ilias Pappas; Matti Mäntymäki (eds.). Responsible AI and Analytics for an Ethical and Inclusive Digitized Society. 20th International Federation of Information Processing WG 6.11 Conference on e-Business, e-Services and e-Society, Galway, Ireland, September 1–3, 2021. Lecture Notes in Computer Science. Vol. 12896. Springer. pp. 629–640. doi:10.1007/978-3-030-85447-8_52. ISBN 978-3-030-85446-1.
  9. ^ Mitchell, James (2023-10-22). "How to Create Artificial intelligence Software". AI Software Developers. Retrieved 2024-03-31.
  10. ^ a b c Toma, Augustin; Senkaiahliyan, Senthujan; Lawler, Patrick R.; Rubin, Barry; Wang, Bo (December 2023). "Generative AI could revolutionize health care — but not if control is ceded to big tech". Nature. 624 (7990): 36–38. doi:10.1038/d41586-023-03803-y. PMID 38036861.
  11. ^ a b Widder, David Gray; Whittaker, Meredith; West, Sarah Myers (November 2024). "Why 'open' AI systems are actually closed, and why this matters". Nature. 635 (8040): 827–833. doi:10.1038/s41586-024-08141-1. ISSN 1476-4687. PMID 39604616.
  12. ^ "What is open source AI and why is profit so important to the debate?". euronews. 20 February 2024. Retrieved 28 November 2024.
  13. ^ a b Liesenfeld, Andreas; Lopez, Alianda; Dingemanse, Mark (19 July 2023). "Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators". Proceedings of the 5th International Conference on Conversational User Interfaces. Association for Computing Machinery. pp. 1–6. arXiv:2307.05532. doi:10.1145/3571884.3604316. ISBN 979-8-4007-0014-9.
  14. ^ Liesenfeld, Andreas; Dingemanse, Mark (5 June 2024). "Rethinking open source generative AI: Open washing and the EU AI Act". The 2024 ACM Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery. pp. 1774–1787. doi:10.1145/3630106.3659005. ISBN 979-8-4007-0450-5.
  15. ^ a b c White, Matt; Haddad, Ibrahim; Osborne, Cailean; Xiao-Yang Yanglet Liu; Abdelmonsef, Ahmed; Varghese, Sachin; Arnaud Le Hors (2024). "The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligence". arXiv:2403.13784 [cs.LG].
  16. ^ "The Open Source AI Definition — by The Open Source Initiative". opensource.org. Retrieved 28 November 2024.
  17. ^ "We finally have a definition for open-source AI". MIT Technology Review. Retrieved 28 November 2024.
  18. ^ Robison, Kylie (28 October 2024). "Open-source AI must reveal its training data, per new OSI definition". The Verge. Retrieved 28 November 2024.
  19. ^ "The Evolution of Open Source: From Software to AI : Argano". argano.com. Retrieved 2024-11-24.
  20. ^ Staff, Kyle Daigle, GitHub (2023-11-08). "Octoverse: The state of open source and rise of AI in 2023". The GitHub Blog. Retrieved 2024-11-24.{{cite web}}: CS1 maint: multiple names: authors list (link)
  21. ^ "Appendix I: A Short History of AI | One Hundred Year Study on Artificial Intelligence (AI100)". ai100.stanford.edu. Retrieved 2024-11-24.
  22. ^ Kautz, Henry (2022-03-31). "The Third AI Summer: AAAI Robert S. Engelmore Memorial Lecture". AI Magazine. 43 (1): 105–125. doi:10.1002/aaai.12036. ISSN 2371-9621.
  23. ^ "Why Software Should Be Free - GNU Project - Free Software Foundation". www.gnu.org. Retrieved 2024-11-24.
  24. ^ a b c "The Power of Collaboration: How Open-Source Projects are Advancing AI".
  25. ^ Staff, Kyle Daigle, GitHub (2023-11-08). "Octoverse: The state of open source and rise of AI in 2023". The GitHub Blog. Retrieved 2024-11-24.{{cite web}}: CS1 maint: multiple names: authors list (link)
  26. ^ Code, Linux (2024-11-03). "A Brief History of Open Source". TheLinuxCode. Retrieved 2024-11-24.
  27. ^ Priya (2024-03-28). "The Evolution of Open Source AI Libraries: From Basement Brawls to AI All-Stars". TheGen.AI. Retrieved 2024-11-24.
  28. ^ "About us". scikit-learn. Retrieved 2024-11-24.
  29. ^ "Testimonials". scikit-learn. Retrieved 2024-11-24.
  30. ^ Makkar, Akashdeep (2021-06-09). "What Is Scikit-learn and why use it for machine learning?". Data Courses. Retrieved 2024-11-24.
  31. ^ a b c Dean, Jeffrey (2022-05-01). "A Golden Decade of Deep Learning: Computing Systems & Applications". Daedalus. 151 (2): 58–74. doi:10.1162/daed_a_01900. ISSN 0011-5266.
  32. ^ Mewawalla, Rahul (31 October 2024). "The democratization of AI: Shaping our collective future". Fast Company.
  33. ^ Costa, Carlos J.; Aparicio, Manuela; Aparicio, Sofia; Aparicio, Joao Tiago (January 2024). "The Democratization of Artificial Intelligence: Theoretical Framework". Applied Sciences. 14 (18): 8236. doi:10.3390/app14188236. hdl:10362/173131. ISSN 2076-3417.
  34. ^ Singh, Kanwar Bharat; Arat, Mustafa Ali (2019). "Deep Learning in the Automotive Industry: Recent Advances and Application Examples". arXiv:1906.08834. {{cite journal}}: Cite journal requires |journal= (help)
  35. ^ Sushumna, Aparna (2024-06-10). "Deep Learning in NLP and Image Recognition". 5DataInc. Retrieved 2024-11-25.
  36. ^ kakkar, Yuvraj (2024-01-23). "Hugging Face 🤗: Revolutionizing AI Collaboration in the Machine Learning Community". Medium. Retrieved 2024-11-25.
  37. ^ a b Xiang, Chloe (2023-02-28). "OpenAI Is Now Everything It Promised Not to Be: Corporate, Closed-Source, and For-Profit". VICE. Retrieved 2024-11-14.
  38. ^ "OpenAI is giving Microsoft exclusive access to its GPT-3 language model". MIT Technology Review. Retrieved 2024-12-08.
  39. ^ "API platform". openai.com. Retrieved 2024-12-08.
  40. ^ Staff, Kyle Daigle, GitHub (2023-11-08). "Octoverse: The state of open source and rise of AI in 2023". The GitHub Blog. Retrieved 2024-11-24.{{cite web}}: CS1 maint: multiple names: authors list (link)
  41. ^ "GPT-3 powers the next generation of apps".
  42. ^ "Generative AI vs. Large Language Models (LLMs): What's the Difference?". appian.com. Retrieved 2024-11-25.
  43. ^ "Projects – LFAI & Data". lfaidata.foundation. Retrieved 2024-12-08.
  44. ^ "LFAI & Data – Linux Foundation Project". lfaidata.foundation. Retrieved 2024-12-08.
  45. ^ a b c "LF AI & Data Landscape". LF AI & Data Landscape. Retrieved 2024-11-14.
  46. ^ "Announcing the PyTorch Foundation to Accelerate Progress in AI Research". Meta. 2022-09-12. Retrieved 2024-11-14.
  47. ^ a b c "PyTorch Foundation". PyTorch. Retrieved 2024-11-14.
  48. ^ a b Mirjalili, Seyedali (2024-08-01). "Meta just launched the largest 'open' AI model in history. Here's why it matters". The Conversation. Retrieved 2024-11-14.
  49. ^ Waters, Richard (2024-10-17). "Meta under fire for 'polluting' open-source". Financial Times. Retrieved 2024-11-14.
  50. ^ a b Gujar, Praveen. "Council Post: Building Trust In AI: Overcoming Bias, Privacy And Transparency Challenges". Forbes. Retrieved 2024-11-25.
  51. ^ a b "Ethical Issues in Open-Source Intelligence | Restackio". www.restack.io. Retrieved 2024-11-25.
  52. ^ Mitchell, Margaret; Wu, Simone; Zaldivar, Andrew; Barnes, Parker; Vasserman, Lucy; Hutchinson, Ben; Spitzer, Elena; Raji, Inioluwa Deborah; Gebru, Timnit (2018-10-05). Model Cards for Model Reporting. pp. 220–229. arXiv:1810.03993. doi:10.1145/3287560.3287596. ISBN 978-1-4503-6125-5.
  53. ^ a b c d "Google Model Cards". modelcards.withgoogle.com. Retrieved 2024-11-25.
  54. ^ Gao, Haoyu; Zahedi, Mansooreh; Treude, Christoph; Rosenstock, Sarita; Cheong, Marc (2024-06-26). "Documenting Ethical Considerations in Open Source AI Models". arXiv:2406.18071 [cs.SE].
  55. ^ Dilhara, Malinda; Ketkar, Ameya; Dig, Danny (2021-07-23). "Understanding Software-2.0: A Study of Machine Learning Library Usage and Evolution". ACM Trans. Softw. Eng. Methodol. 30 (4): 55:1–55:42. doi:10.1145/3453478. ISSN 1049-331X.
  56. ^ a b Pedregosa, Fabian; Varoquaux, Gaël; Gramfort, Alexandre; Michel, Vincent; Thirion, Bertrand; Grisel, Olivier; Blondel, Mathieu; Prettenhofer, Peter; Weiss, Ron; Dubourg, Vincent; Vanderplas, Jake; Passos, Alexandre; Cournapeau, David; Brucher, Matthieu; Perrot, Matthieu (2011). "Scikit-learn: Machine Learning in Python". Journal of Machine Learning Research. 12 (85): 2825–2830. arXiv:1201.0490. Bibcode:2011JMLR...12.2825P. ISSN 1533-7928.
  57. ^ Abadi, Martín (2016-09-04). "TensorFlow: Learning functions at scale". Proceedings of the 21st ACM SIGPLAN International Conference on Functional Programming. ICFP 2016. New York, NY, USA: Association for Computing Machinery. p. 1. doi:10.1145/2951913.2976746. ISBN 978-1-4503-4219-3.
  58. ^ Paszke, Adam; Gross, Sam; Massa, Francisco; Lerer, Adam; Bradbury, James; Chanan, Gregory; Killeen, Trevor; Lin, Zeming; Gimelshein, Natalia (2019-12-08), "PyTorch: an imperative style, high-performance deep learning library", Proceedings of the 33rd International Conference on Neural Information Processing Systems, Red Hook, NY, USA: Curran Associates Inc., pp. 8026–8037, arXiv:1912.01703, retrieved 2024-11-15
  59. ^ Devlin, Jacob; Chang, Ming-Wei; Lee, Kenton; Toutanova, Kristina (2019-05-24), BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, arXiv:1810.04805
  60. ^ Touvron, Hugo; Lavril, Thibaut; Izacard, Gautier; Martinet, Xavier; Lachaux, Marie-Anne; Lacroix, Timothée; Rozière, Baptiste; Goyal, Naman; Hambro, Eric (2023-02-27), LLaMA: Open and Efficient Foundation Language Models, arXiv:2302.13971
  61. ^ Chang, Yupeng; Wang, Xu; Wang, Jindong; Wu, Yuan; Yang, Linyi; Zhu, Kaijie; Chen, Hao; Yi, Xiaoyuan; Wang, Cunxiang; Wang, Yidong; Ye, Wei; Zhang, Yue; Chang, Yi; Yu, Philip S.; Yang, Qiang (2024-03-29). "A Survey on Evaluation of Large Language Models". ACM Trans. Intell. Syst. Technol. 15 (3): 39:1–39:45. arXiv:2307.03109. doi:10.1145/3641289. ISSN 2157-6904.
  62. ^ Junczys-Dowmunt, Marcin; Grundkiewicz, Roman; Dwojak, Tomasz; Hoang, Hieu; Heafield, Kenneth; Neckermann, Tom; Seide, Frank; Germann, Ulrich; Aji, Alham Fikri (2018-04-04), Marian: Fast Neural Machine Translation in C++, arXiv:1804.00344
  63. ^ Klein, Guillaume; Kim, Yoon; Deng, Yuntian; Senellart, Jean; Rush, Alexander M. (2017-03-06), OpenNMT: Open-Source Toolkit for Neural Machine Translation, arXiv:1701.02810
  64. ^ a b Aulamo, Mikko; Tiedemann, Jörg (September 2019). Hartmann, Mareike; Plank, Barbara (eds.). "The OPUS Resource Repository: An Open Package for Creating Parallel Corpora and Machine Translation Services". Proceedings of the 22nd Nordic Conference on Computational Linguistics. Turku, Finland: Linköping University Electronic Press: 389–394.
  65. ^ Koehn, Philipp (2005-09-13). "Europarl: A Parallel Corpus for Statistical Machine Translation". Proceedings of Machine Translation Summit X: Papers. Phuket, Thailand: 79–86.
  66. ^ a b Pulli, Kari; Baksheev, Anatoly; Kornyakov, Kirill; Eruhimov, Victor (June 2012). "Real-time computer vision with OpenCV". Communications of the ACM. 55 (6): 61–69. doi:10.1145/2184319.2184337. ISSN 0001-0782 – via ACM.
  67. ^ a b Culjak, Ivan; Abram, David; Pribanic, Tomislav; Dzapo, Hrvoje; Cifrek, Mario (21–25 May 2012). "A brief introduction to OpenCV". Proceedings of the 35th International Convention MIPRO – via IEEE.
  68. ^ Redmon, Joseph; Divvala, Santosh; Girshick, Ross; Farhadi, Ali (2016-05-09), You Only Look Once: Unified, Real-Time Object Detection, arXiv:1506.02640
  69. ^ facebookresearch/detectron2, Meta Research, 2024-11-16, retrieved 2024-11-16
  70. ^ a b Dosovitskiy, Alexey; Beyer, Lucas; Kolesnikov, Alexander; Weissenborn, Dirk; Zhai, Xiaohua; Unterthiner, Thomas; Dehghani, Mostafa; Minderer, Matthias; Heigold, Georg (2021-06-03), An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, arXiv:2010.11929
  71. ^ Khan, Salman; Naseer, Muzammal; Hayat, Munawar; Zamir, Syed Waqas; Khan, Fahad Shahbaz; Shah, Mubarak (2022-01-31). "Transformers in Vision: A Survey". ACM Computing Surveys. 54 (10s): 1–41. arXiv:2101.01169. doi:10.1145/3505244. ISSN 0360-0300.
  72. ^ a b Macenski, Steve; Foote, Tully; Gerkey, Brian; Lalancette, Chris; Woodall, William (2022-05-25). "Robot Operating System 2: Design, Architecture, and Uses In The Wild". Science Robotics. 7 (66): eabm6074. arXiv:2211.07752. doi:10.1126/scirobotics.abm6074. ISSN 2470-9476. PMID 35544605.
  73. ^ M, Quigley (2009). "ROS : an open-source Robot Operating System". Proc. Open-Source Software Workshop of the Int'l. Conf. On Robotics and Automation (ICRA), 2009.
  74. ^ Koenig, N.; Howard, A. (2004). "Design and use paradigms for gazebo, an open-source multi-robot simulator". 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566). Vol. 3. IEEE. pp. 2149–2154. doi:10.1109/iros.2004.1389727. ISBN 0-7803-8463-6.
  75. ^ a b Esteva, Andre; Robicquet, Alexandre; Ramsundar, Bharath; Kuleshov, Volodymyr; DePristo, Mark; Chou, Katherine; Cui, Claire; Corrado, Greg; Thrun, Sebastian; Dean, Jeff (January 2019). "A guide to deep learning in healthcare". Nature Medicine. 25 (1): 24–29. doi:10.1038/s41591-018-0316-z. ISSN 1546-170X. PMID 30617335.
  76. ^ Ashraf, Mudasir; Ahmad, Syed Mudasir; Ganai, Nazir Ahmad; Shah, Riaz Ahmad; Zaman, Majid; Khan, Sameer Ahmad; Shah, Aftab Aalam (2021). "Prediction of Cardiovascular Disease Through Cutting-Edge Deep Learning Technologies: An Empirical Study Based on TENSORFLOW, PYTORCH and KERAS". In Gupta, Deepak; Khanna, Ashish; Bhattacharyya, Siddhartha; Hassanien, Aboul Ella; Anand, Sameer; Jaiswal, Ajay (eds.). International Conference on Innovative Computing and Communications. Advances in Intelligent Systems and Computing. Vol. 1165. Singapore: Springer. pp. 239–255. doi:10.1007/978-981-15-5113-0_18. ISBN 978-981-15-5113-0.
  77. ^ Korshunova, Maria; Ginsburg, Boris; Tropsha, Alexander; Isayev, Olexandr (2021-01-25). "OpenChem: A Deep Learning Toolkit for Computational Chemistry and Drug Design". Journal of Chemical Information and Modeling. 61 (1): 7–13. doi:10.1021/acs.jcim.0c00971. ISSN 1549-9596. PMID 33393291.
  78. ^ a b Juhn, Young; Liu, Hongfang (2020-02-01). "Artificial intelligence approaches using natural language processing to advance EHR-based clinical research". Journal of Allergy and Clinical Immunology. 145 (2): 463–469. doi:10.1016/j.jaci.2019.12.897. ISSN 0091-6749. PMC 7771189. PMID 31883846.
  79. ^ Pomfret, James; Pang, Jessie; Pomfret, James; Pang, Jessie (2024-11-01). "Exclusive: Chinese researchers develop AI model for military use on back of Meta's Llama". Reuters. Retrieved 2024-11-16.
  80. ^ a b c Roth, Emma (2024-11-04). "Meta AI is ready for war". The Verge. Retrieved 2024-11-16.
  81. ^ a b c "Democratizing AI | IBM". www.ibm.com. 2024-11-05. Retrieved 2024-11-25.
  82. ^ a b c Models, A. I. "Open Source AI: A look at Open Models". Open Source AI Models. Retrieved 2024-11-25.
  83. ^ a b c DiChristofano, Alex; Shuster, Henry; Chandra, Shefali; Patwari, Neal (2023-02-09), Global Performance Disparities Between English-Language Accents in Automatic Speech Recognition, arXiv:2208.01157
  84. ^ a b c Gujar, Praveen. "Council Post: Building Trust In AI: Overcoming Bias, Privacy And Transparency Challenges". Forbes. Retrieved 2024-11-27.
  85. ^ Chen, Hailin; Jiao, Fangkai; Li, Xingxuan; Qin, Chengwei; Ravaut, Mathieu; Zhao, Ruochen; Xiong, Caiming; Joty, Shafiq (2024-01-15), ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?, arXiv:2311.16989
  86. ^ Sandbrink, Jonas (2023-08-07). "ChatGPT could make bioterrorism horrifyingly easy". Vox. Retrieved 2024-11-14.
  87. ^ "White House says no need to restrict open-source AI, for now". PBS News. 2024-07-30. Retrieved 2024-11-14.
  88. ^ a b c Jacobs, Abigail Z.; Wallach, Hanna (2021-03-12), "Measurement and Fairness", Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pp. 375–385, arXiv:1912.05511, doi:10.1145/3442188.3445901, ISBN 978-1-4503-8309-7
  89. ^ a b c d e f g "Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification" (PDF). Proceedings of Machine Learning Research.
  90. ^ Kathikar, Adhishree; Nair, Aishwarya; Lazarine, Ben (2023). "Assessing the Vulnerabilities of the Open-Source Artificial Intelligence (AI) Landscape: A Large-Scale Analysis of the Hugging Face Platform". 2023 IEEE International Conference on Intelligence and Security Informatics (ISI). pp. 1–6. doi:10.1109/ISI58743.2023.10297271. ISBN 979-8-3503-3773-0.
  91. ^ a b c Gao, Haoyu; Zahedi, Mansooreh; Treude, Christoph; Rosenstock, Sarita; Cheong, Marc (2024-06-26). "Documenting Ethical Considerations in Open Source AI Models". arXiv:2406.18071 [cs.SE].
  92. ^ Gohel, Prashant; Singh, Priyanka; Mohanty, Manoranjan (12 July 2021). "Explainable AI: current status and future directions". arXiv:2107.07045 [cs.LG].
  93. ^ a b Mitchell, Margaret; Wu, Simone; Zaldivar, Andrew; Barnes, Parker; Vasserman, Lucy; Hutchinson, Ben; Spitzer, Elena; Raji, Inioluwa Deborah; Gebru, Timnit (2018-10-05). Model Cards for Model Reporting. pp. 220–229. arXiv:1810.03993. doi:10.1145/3287560.3287596. ISBN 978-1-4503-6125-5.
  94. ^ a b Gebru, Timnit; Morgenstern, Jamie; Vecchione, Briana; Vaughan, Jennifer Wortman; Wallach, Hanna; Daumé III, Hal; Crawford, Kate (2021-12-01), Datasheets for Datasets, arXiv:1803.09010
  95. ^ White, Matt; Haddad, Ibrahim; Osborne, Cailean; Liu, Xiao-Yang Yanglet; Abdelmonsef, Ahmed; Varghese, Sachin; Hors, Arnaud Le (2024-10-18), The Model Openness Framework: Promoting Completeness and Openness for Reproducibility, Transparency, and Usability in Artificial Intelligence, arXiv:2403.13784
Quelle: https://en.wikipedia.org/wiki/Open-source_artificial_intelligence