Senior Data Engineering
Tasks
- Build automated test frameworks
- Build batch and near real time pipelines
- Collaborate with product and engineering teams
- Create stored procedures functions and triggers
- Design automated tests
- Design, develop, and maintain ETL/ELT pipelines
- Ensure data quality and integrity
- Execute automated tests
- Implement snowflake schema
- Implement star schema
- Improve automated test coverage
- Integrate data from APIs databases and flat files
- Migrate pipelines to cloud
- Model data in data warehouse data marts
- Optimize database performance
- Participate in code reviews and maintain documentation
- Translate business requirements into data solutions
- Write complex SQL queries
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Beam | Apache Spark | BigQuery | CI/CD | Cloud Storage | DBT | Data Modeling | Data Partitioning | Data Quality | Data Warehousing | Dataflow | Dataproc | ELT | ETL | Hadoop | Indexing | Informatica | MySQL | Oracle | PLSQL | PostgreSQL | PubSub | Python | Query Tuning | SQL | SQL Server | Shell Scripting | Talend
Education
N/A
Related jobs
-
GenAI Engineer INR 1200K-4500KAI Studio | AKS | App Service | Autogen | AzureCareer growth programs | Flexible work arrangements | Flexible work hours | Generative AI Certifications Support | Remote work optionMid-level Full TimeGurgaon, IN6h ago
-
Lead Data engineer, Sr. Specialist INR 2800K-3880KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Domestic relocation | Flexible work arrangements | Hybrid work arrangements | Travel 10 percentSenior-level Full TimeIND - Telangana - Hyderabad, India9h ago
-
Staff Software Engineer (Python) INR 3000K-5000KAPIs | Alerting | Amazon Web Services | Authentication | Batch ProcessingCollaborative team environment | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India17h ago
-
Entry-level InternshipHyderabad, India18h ago
-
Entry-level InternshipHyderabad, India18h ago
-
Assistant Manager INR 1000K-2000KBusiness Intelligence | Data Modeling | Data Quality | Logistic Regression | Machine LearningMid-level Full TimeIndia18h ago
-
DTICI_T8_Data_engineer_Manufacturing_Operations INR 1500K-2500KAgile | Apache Spark | Azure | Azure Blob | Azure Blob StorageSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
AWS | Airflow | Apache Spark | Azure | Cause analysisSenior-level Full TimePune, Maharashtra, India19h ago
-
AWS Snowflake INR 1500K-2000KAmazon Web Services | DBT | Data Modeling | Data Pipelines | Data WarehousingMid-level Full TimeIN-TN-Chennai19h ago
-
Confluent Kafka Data Engineer INR 1500K-2500KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-KA-Bangalore19h ago
-
GEN AI Developer INR 2000K-5000KAgile | Continuous integration | Data Modeling | Generative AI | Language ProcessingSenior-level Full TimeIN-KA-Bangalore19h ago
-
AI Automation Expert INR 2000K-5000KAgentic AI | Azure OpenAI | Confluence | Copilot Studio | Enterprise IntegrationSenior-level Full TimeIN-KA-Bangalore19h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIN-MH-Mumbai19h ago
-
GCP Data Engineer INR 1500K-2500KADLS Gen2 | Airflow | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-MH-Mumbai19h ago
-
Mid-level Full TimeIndia19h ago
-
Principal AI Engineer with Java INR 2475K-4800KAI Services | Agent Framework | Agentic AI | Alembic | AutogenEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India20h ago
-
Sr. Associate Director, Software Engineering Specialist INR 1600K-2400KAirflow | Apache Beam | Apache Flink | BigQuery | CI/CDFlexible working | Inclusive workplace | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R20h ago
-
APIs | Access Management | Agentic AI | Audit Logging | Automated testing401k retirement plan | Dental insurance | Flexible work arrangements | Fully remote | Medical insuranceSenior-level Full TimeIndia R20h ago
-
Mid-level Full TimePune, Maharashtra, India20h ago
-
Senior Software Engineer, AI/ML Computer Vision, Google Cloud INR 3000K-5000KC++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Lead Assistant Manager INR 1500K-2800KAccess Control | Caching | Data Governance | Databricks | Databricks SQLSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Associate Director - Forward Deployed Engineer/AI Engineer INR 1500K-3000KAI Foundry | AWS Bedrock | Agent systems | App Service | Artificial IntelligenceMid-level Full TimeBangalore, Karnataka, India21h ago
-
Senior-GDC INR 2400K-3500KAPIs | Azure | Azure Data | Azure Data Factory | Azure DatabricksCoaching junior engineers | Knowledge transferSenior-level Full TimeBangalore, Karnataka, India21h ago
-
Associate Director- AI Engineer - Solution Architect INR 1500K-3000KAI Act | Agent systems | App Service | Azure App | Azure App ServiceMid-level Full TimeBangalore, Karnataka, India21h ago
-
Assistant Manager - Azure Data Engineer INR 1500K-2000KApache Spark | Azure | DBX Notebooks | Data Infrastructure | Data ModelingMid-level Full TimeBangalore, Karnataka, India22h ago