Principal Data Engineer
Tasks
- Administer Airflow environment
- Administer Cloud Composer
- Build data pipelines
- Catalog data
- Conduct code reviews
- Conduct design reviews
- Create dbt models
- Create dbt tests
- Define data quality standards
- Deploy dbt models
- Design ETL/ELT pipelines
- Document dbt models
- Maintain data lineage
- Maintain data pipelines
- Manage data lifecycle
- Mentor junior data engineers
- Optimize Airflow environment
- Own dbt transformation layer
- Resolve production data pipeline issues
- Troubleshoot production pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Airflow | Apache Kafka | Automated testing | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | DBT Core | Data Catalog | Data Lineage | Data Modeling | Data Quality | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Google Cloud Storage | Python | SQL
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior-level Full TimePune, India1h ago
-
Senior Data Engineer - AWS INR 1500K-4000KAWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon RedshiftSenior-level Full TimeBangalore, India4h ago
-
Mid-level Full TimeBangalore - Karnataka - India Pune …5h ago
-
Mid-level Full TimeHyderabad, TS, 500032, IN5h ago
-
Senior-level Full TimeIN-MH-Pune6h ago
-
Network Data Scientist INR 2500K-4500KApplication Traffic Analysis | CI/CD | DNS | Data Pipelines | GitLab CISenior-level Full TimePune, IN6h ago
-
Algorithm Development | Automated trading | C++ | Electronic Trading | Financial MathematicsMid-level Full TimeHyderabad, Telangana, India6h ago
-
Agentic AI Engineer INR 1200K-2500KAgentic architecture | Distributed Systems | Docker | LLM | LanggraphMid-level Full TimeKarnataka, Bengaluru, India7h ago
-
Entry-level Full Timehosur road bangalore, India7h ago
-
Senior-level Full TimeBengaluru, India7h ago
-
[T] Senior Software Engineer, AI/ML, Google Cloud INR 3000K-5000KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeBengaluru, India7h ago
-
Associate Software Engineer INR 1200K-2800KAgile | C# | Cloud Development | Containerization | DHTMLMid-level Full TimeKolkata, India7h ago
-
Senior-level Full TimeBengaluru, India7h ago
-
Senior-level Full TimeKolkata, India7h ago
-
Software Engineer II - Big Data INR 1500K-2500KAWS | Ab Initio | Apache Spark | Batch Processing | Data MiningMid-level Full TimeHyderabad, Telangana, India8h ago
-
Software Engineer III - Big Data INR 2200K-4200KAWS | Ab Initio | Apache Spark | Application deployment | Batch ProcessingSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior AI Engineer – (Land Services) INR 2000K-3400KAI Foundry | AI Search | APIs | Agentic AI | ArcGISSenior-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Software Engineer II INR 1600K-2800KAgile | Application Resiliency | CI/CD | Cloud technologies | Data AnalysisMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Full Stack Analytics Engineer INR 1500K-3000KAirflow | Amazon Redshift | Azure Synapse | CI/CD | Cloud ComputingSenior-level Full TimeMumbai, India10h ago
-
Full Stack Analytics Engineer INR 1500K-3000KAirflow | Amazon Redshift | Amazon Web Services | Azure | Azure SynapseSenior-level Full TimeMumbai, India10h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Apache Airflow | Apache Kafka | Apache SparkBike to work | Career progression and mentorship coaching | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeMumbai, MH, India10h ago
-
Principal Engineer, Data Analytics Engineering [ 8+ years ] (Java/Python | Kafka | Kubernetes) INR 2000K-3584KAWS | Agile | Algorithms | Apache Spark | AutomationSenior-level Full TimeBengaluru, KA, India11h ago
-
Principal Data Engineer INR 1500K-3500KAPIs | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactorySenior-level Full TimeIndia, Telangana, Hyderabad11h ago
-
Senior-level Full TimeHyderabad, India11h ago