Code as data
DataForge cloud is backed by a relational database that combines compiled functional code, orchestration details, operational metrics, and other metadata into queryable tables to track every element of the platform. No need to rely on code scans or third party tools for observability. Now all your live production data code is where it should be - in easy to query tables.
The next generation of data observability
Search your code with SQL
Live code tables
Upon import into DataForge Cloud, functional code is mapped into relational tables. Now, rather than relying on Ctrl-F, you can write custom SQL to analyze your code base. With a row of data for every line of code, find the exact detail you need in seconds.
Monitor, detect, resolve
Granular processing views
Deploy custom data quality rules, processing alert notifications, monitor infrastructure stability, and track data profiles. All code executions, logs, and alerts are saved in the same relational database as your code, ready for query. Column-level lineage makes diagnoses and resolution of issues quick and efficient.
Auditability and compliance
Transparent governance
DataForge tracks how every line of code touches every cell of data for every execution. Quickly identify who changed what and for what purpose, fully integrated with modern CI/CD tools and workflows. Run hyper-granular audit reports for compliance with a single query.
Analyze the full stack
Live infrastructure
With visibility and detailed metadata across runtime, compute, and storage costs tied to every process in DataForge, it is easy to track and monitor cloud spend. Build automated alerts to detect usage spikes and use built-in tools to tweak and test different infrastructure configurations.
DataForge Cloud
Dataforge Cloud is the fastest and most reliable way to deploy DataForge. Develop, orchestrate, operate, and audit functional code pipelines in an all-in-one web-based UI.
DataForge Core
DataForge Core is an open source command line tool that enables teams to write functional data transformation code following software engineering best practices and principles.