Lead Expert Data Engineer- Procurement
Tasks
- Collaborate with data modelers and business partners
- Design data pipeline architectures
- Develop data transformation code
- Implement automated data quality testing
- Implement data ingestion transformation and storage
- Maintain and upgrade pipelines
- Manage data engineering projects and initiatives
- Perform ETL from source systems
- Troubleshoot pipeline issues
- Validate data integrity
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Azure | Azure DevOps | CI/CD | DBT | Data Governance | Data Modeling | Data Quality | Data Validation | Databricks | ETL | Git | Infrastructure as Code | PySpark | Python | SQL | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AWS | Amazon Aurora | Amazon RDS | Amazon S3 | CI/CDMid-level Full TimeDahisar West, Maharashtra4h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 1300K-2000KAmazon Aurora | Amazon S3 | Amazon Web Services | Backup and Recovery | CDCMid-level Full TimeMumbai, MH4h ago
-
DevOps / AWS Data Platform Engineer (Databricks, Snowflake, Aurora, S3, DBT) - Mumbai, MH - AS A INR 1500K-2500KAWS S3 | Alerting | Amazon Aurora | Amazon RDS | Amazon Web ServicesMid-level Full TimeMumbai, MH4h ago
-
Apache Spark | Data Pipelines | Data Validation | Databricks | Feature EngineeringMid-level Full TimeMumbai, MH4h ago
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde7h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India7h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India8h ago
-
Senior-level Full TimeIN-KA-Bangalore8h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai8h ago
-
Expert Data Engineer INR 3500K-4200KAPI Integration | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingHybrid workSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Data Analytics and Reporting Lead INR 3200K-4500KAmazon Web Services | Azure | DAX | Data Modeling | Data WarehousingEmployee assistance program | Flexible work options | Paid time off | Service recognition awards | Training and development programsSenior-level Full TimeBengaluru, KA, India8h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Amazon S3 | Apache Iceberg | Cloud Computing | Concurrency | Data ModelingCareer development | Health benefits | Paid time off | Remote work flexibilitySenior-level Full TimeHyderabad, India9h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Data Science Manager I, AI/ML INR 2500K-5000KAdverse impact analysis | Agent Development | Applied Mathematics | Data Modeling | Database queryingSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Application Engineer, Master Data Governance INR 1000K-1500KABAP | Data Governance | Data Management | Fiori | Master DataMid-level Full TimeHyderabad, Telangana, India9h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | Apache NiFi | BigQueryFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R9h ago
-
Expert Data & AI Engineer INR 3000K-4000KAWS | Apache Spark | Automation | Azure | Azure DevOpsCareer development opportunities | Collaborative culture | Learning opportunities | Team leadership opportunitiesSenior-level Full TimeHyderabad, India10h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4680KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Fine TuningHealth and wellness programs | Time awaySenior-level Full TimeBengaluru, KA, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, IN10h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN10h ago
-
Senior-level Full TimeHyderabad, Telangana, India11h ago
-
Principal Software Engineer INR 2000K-4800KAlgorithms | Auditability | Automation | Azure | Cause analysisSenior-level Full TimeIndia, Karnataka, Bangalore11h ago
-
Data Engineer - Associate Director INR 1500K-2600KAWS | AWS Glue | Agile | Apache Airflow | Apache HadoopMid-level Full TimeBangalore, Karnataka, India11h ago