Technology

Data transformation

Data transformation converts raw, inconsistent source data into a clean, standardized, and structured format, making it ready for immediate analysis.

Data transformation is the critical 'T' in the Extract, Transform, Load (ETL) or ELT pipeline: it cleans, maps, and aggregates raw data into a unified, usable structure. This step is non-negotiable for generating quality insights, as source data is often inconsistent (e.g., varying date formats, missing fields). We leverage powerful tools like dbt (Data Build Tool) and robust SQL scripts to standardize, enrich, and restructure disparate tables into analytics-ready schemas (e.g., star or snowflake schemas). This process ensures all Business Intelligence (BI) dashboards and Machine Learning (ML) models operate from a single, trusted source of truth, directly enabling smarter, faster business decisions.

https://atlan.com/data-transformation-definition-process-examples-tools

What builders pair with Data transformation

Projects using both technologies. Select a pairing to see a project.

Built with Data transformation

Amazon Kinesis Data Streams 1 shared project Apache Flink 1 shared project Apache Kafka 1 shared project Apache Spark Structured Streaming 1 shared project Apache Storm 1 shared project BERT 1 shared project

10 more pairings

BLOOM 1 shared project Google Cloud Dataflow 1 shared project GPT-3 1 shared project GPT-4 1 shared project Kafka Streams 1 shared project Llama-2 1 shared project Multimodal AI 1 shared project nutritionGPT 1 shared project PaLM 2 1 shared project RoBERTa 1 shared project

Pairing: Amazon Kinesis Data Streams

LLM's are more than a chatbot - nutritionGPT

Chicago · January 23, 2024

view project | view Amazon Kinesis Data Streams

Recent Talks & Demos

Showing 1-1 of 1

Members-Only

Sign in to see who built these projects

Sign in View FAQ

nutritionGPT: LLM Nutrition Pipeline

nutritionGPT GPT-4