Data Engineer
Tasks
- Build data lake pipelines
- Build data warehouse pipelines
- Collaborate with data scientists and ML engineers
- Design ETL pipelines
- Develop PySpark jobs
- Develop Python data processing
- Document code and processes
- Maintain ETL pipelines
- Monitor data pipelines
- Orchestrate workflows with Airflow
- Resolve data quality issues
- Troubleshoot pipeline performance issues
- Write SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Azure | Data Compliance | Data Governance | Data Lakes | Data Processing | Data Security | Data Warehousing | Git | Google Cloud | Langchain | Llamaindex | PostgreSQL | PySpark | Python | Redshift | SQL | Unstructured Data | Unstructured Data Processing | Vector Databases
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeHyderabad, IN3h ago
-
Lead / Manager Agentic AI Engineer - Claude Code & Codex INR 2000K-4500KAWS | Asynchronous programming | Autogen | Azure | CI/CDSenior-level Full TimeHyderabad, TS, India4h ago
-
Data Engineer INR 1500K-2200KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN5h ago
-
Senior Data Engineer INR 1500K-2600KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageSenior-level Full TimeHyderabad, IN5h ago
-
Senior-level Full TimeGurgaon, HR, India6h ago
-
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000KAPI Development | Amazon Web Services | Apache Spark | CI/CD | DBTSenior-level Full TimeBangalore, Karnataka, IN, 5601006h ago
-
(Senior) Software Engineer (all genders) 1 INR 3600K-4720KAI Safety | AWS | Amazon Web Services | Apache Spark | Automated testingSenior-level Full TimeBangalore, Karnataka, IN, 5601006h ago
-
AI Engineer (India, China) INR 2500K-4064KAPIs | AWS | Airflow | Apache Spark | AutogenAnnual leave | Flexible working | Life insurance | Medical insurance | Parental leaveMid-level Full TimeBangalore, IN7h ago
-
Mid-level Full TimeIndia - Bengaluru8h ago
-
Adversarial Training | Arize | Audio Processing | Automatic Speech Recognition | Dataset SynthesisChai or coffee | ESOP | Flexible work environment | Free lunch | Workspace perksEntry-level Full TimeNew Delhi, India8h ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R9h ago
-
Senior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN10h ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R12h ago
-
API Testing | AWS | Azure | BLEU | Bias TestingOnsite workSenior-level Full TimeBengaluru, India12h ago
-
Senior-level Full TimeChennai, Chennai-MRV-AD, IN12h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …12h ago
-
Sr Technical Lead-BI INR 1500K-2700KDAX | Data Modeling | Data Warehousing | Dimensional Modeling | ETLSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …12h ago
-
Sr Technical Lead-BI INR 1500K-2700KBI Data modeling | DAX | Data Modeling | Data Warehousing | Dimensional ModelingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …12h ago
-
AI / ML Engineer INR 2000K-5000KAI Services | Chatbots | Cloud AI | Cloud AI services | Deep learningSenior-level Full TimeChennai, CDC2A, India12h ago
-
Senior-level Full TimeBengaluru, BDC7C, India12h ago
-
Data Engineer INR 1500K-2500KCloud Computing | Data Modeling | Data Pipelines | Data Quality | Data WarehouseSenior-level Full TimeGurugram, DDC5E, India12h ago
-
Data Engineer INR 1500K-2500KAWS DynamoDB | AWS S3 | Amazon Redshift | Data Governance | Data Pipeline ArchitectureSenior-level Full TimeGurugram, DDC5E, India12h ago
-
Senior-level Full TimePune IN (Office: 5th & 6th …12h ago
-
Data Engineer INR 1500K-2500KData Governance | Data Quality | Data Security | Data Warehouse | Data integrationSenior-level Full TimeBengaluru, BDC7A, India12h ago
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Storage | Cloud data processing | Data Modeling | Data ProcessingMid-level Full TimeBengaluru, BDC7A, India12h ago