LF AI and Data
The LF AI & Data Foundation is a Linux Foundation umbrella that advances open source artificial intelligence, machine learning, and data projects. It hosts 80+ projects spanning graduated, incubation, and sandbox stages, including ONNX, Milvus, Horovod, Flyte, Kedro, Pyro, Egeria, OpenLineage, Marquez, and the Adversarial Robustness Toolbox, fostering scalable, trustworthy, and interoperable AI and data solutions.
APIs
ONNX
Open Neural Network Exchange (ONNX) is an open format for representing deep learning models, enabling interoperability between AI frameworks.
Milvus
Milvus is an open source vector database built for scalable similarity search, supporting embedding-based AI applications.
Horovod
Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
Flyte
Flyte is a production-grade, cloud-native workflow orchestration platform for data and machine learning processes.
Kedro
Kedro is a Python framework for creating reproducible, maintainable, and modular data science code.
OpenLineage
OpenLineage is an open standard and API for collecting lineage metadata across data pipelines.
Marquez
Marquez is an open source metadata service for the collection, aggregation, and visualization of a data ecosystem's metadata.
Egeria
Egeria is the world's first open source metadata standard for enterprise data management, enabling unified governance and discovery.
Adversarial Robustness Toolbox
ART (Adversarial Robustness Toolbox) provides tools for evaluating and defending machine learning models against adversarial threats.
Delta Lake
Delta Lake is an open source storage layer that brings ACID transactions and reliability to data lakes.
Feast
Feast is an open source feature store for machine learning, providing consistent feature serving across training and inference.