Data Engineer
Tasks
- Build data lake pipelines
- Build data warehouse pipelines
- Collaborate with data scientists and ML engineers
- Design ETL pipelines
- Develop PySpark jobs
- Develop Python data processing
- Document code and processes
- Maintain ETL pipelines
- Monitor data pipelines
- Orchestrate workflows with Airflow
- Resolve data quality issues
- Troubleshoot pipeline performance issues
- Write SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Azure | Data Compliance | Data Governance | Data Lakes | Data Processing | Data Security | Data Warehousing | Git | Google Cloud | Langchain | Llamaindex | PostgreSQL | PySpark | Python | Redshift | SQL | Unstructured Data | Unstructured Data Processing | Vector Databases
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeNoida,Uttar Pradesh,India R5h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeDedicated budget for education | Dedicated budget for wellness | Legal presence in India | Local connection | Periodic meet upsSenior-level Full TimeKolkata, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIGrowth education budget | Innovative projects | Local connection | Periodic meet ups | Remote workSenior-level Full TimeMumbai, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | FastAPI | Infrastructure as CodeDedicated budgets for growth | Education budget | Global clients | Innovative projects | Local connectionSenior-level Full TimeChennai, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionGrowth education budget | Innovative projects | Local connection | Periodic meet ups | Remote workSenior-level Full TimeJaipur, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIEducation budget | Growth budget | Innovative projects | Local connection | MeetupsSenior-level Full TimeAhmedabad, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS S3 | Anthropic API | CI/CD | Drift Detection | FastAPIEducation budget | Growth budget | Innovative projects | Periodic team meetups | Remote workSenior-level Full TimeNoida, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | AWS S3 | Anthropic API | CI/CD | Drift DetectionEducation budget | Growth budget | Local connection | Modern technology projects | Periodic meet upsSenior-level Full TimeJalalabad, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIGrowth education budget | Innovative projects | Local legal compliance in India | Local team connection | Remote workSenior-level Full TimeIndore, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeBudgets for growth | Education budget | Innovative projects | Local connection | Remote workSenior-level Full TimeTrivandrum, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | AWS S3 | Anthropic API | CI/CD | Cloud SecurityLocal connection | Remote workSenior-level Full TimeNew Delhi, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIBudget for growth | Education support | Innovative projects | Legal compliance India | Local connectionSenior-level Full TimeHyderabad, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIDedicated budgets for growth | Education budget | Innovative projects | Local team connection | MeetupsSenior-level Full TimePune City, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Cloud Security | FastAPIEducation budget | Growth budget | Innovative projects | Local team connection | Remote workSenior-level Full TimeBangalore North, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIBudgets for education | Budgets for wellness | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeCoimbatore South, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-4800KAWS | Anthropic | CI/CD | Cloud Drift Detection | Drift DetectionDedicated budgets for growth | Education support | Innovative projects | Legal presence in India | Local connectionSenior-level Full TimeGurgaon Kty., India9h ago
-
Senior Security Software Engineer ID80139 JPY 8600K-12500KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionEducation budget | Growth budget | Innovative projects | Local connection | Periodic team meet upsSenior-level Full TimeKochi, India9h ago
-
Senior-level Full TimeBangalore, Karnataka10h ago
-
Data Engineer INR 2000K-2700KAWS Redshift | Agile | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsHybrid workingMid-level Full TimeIndia R10h ago
-
Snowflake Developer INR 1500K-2200KAgile | Automated Deployment | CI/CD | Data Ingestion | Data LakeSenior-level Full TimeIN-HR-Gurgaon10h ago
-
Senior-level Full TimeIN-TN-Chennai10h ago
-
DE&A - AIML - Data Science - Machine Learning INR 2500K-5000KAI Agents | AWS | Azure | CI/CD | Cloud ComputingSenior-level Full TimeIndia10h ago
-
Practice Customer Engineer, Data Analytics INR 1500K-3000KApache Spark | Batch Processing | Big Data | C++ | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India12h ago
-
Staff Software Engineer, AI Garage INR 2500K-5000KAI Evaluation | Agentic AI | Artificial Intelligence | C plus plus | C#Senior-level Full TimeHyderabad, Telangana, India12h ago