Data Engineer
Tasks
- Add error handling and retries
- Create Power BI dashboards and reports
- Create Power BI data models measures DAX
- Design data ingestion pipelines
- Develop Azure Data Factory pipelines
- Develop SQL queries stored procedures views
- Handle OAuth API keys bearer tokens
- Implement incremental loads
- Implement pagination
- Integrate data from REST APIs
- Load data to Azure Blob Storage
- Load data to Azure SQL Database
- Maintain code with Azure DevOps
- Monitor scheduled pipelines
- Optimize SQL performance
- Perform code reviews
- Perform historical backfills
- Support pipeline failures
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
API Keys | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure DevOps | Azure SQL | Azure SQL Database | Bearer tokens | Blob Storage | DAX | Data Factory | Error Handling | Git | Historical Backfills | Incremental loads | OAuth | Pagination | Performance Tuning | Power BI | REST API | Retries | SQL | SQL Database | Stored Procedures | Views | Window Functions
Education
N/A
Roles
Related jobs
-
SW Architect - AI Engineering INR 2500K-5000KAPI Development | AWS | Azure | Cloud platform | Cost OptimizationContinuous learning opportunities | Hybrid work opportunities | Supportive, inclusive work environment | Training programsSenior-level Full TimePune - Maharashtra - India1d ago
-
AI Solutions Engineer – Quality & Digitalization INR 2500K-4500KAnomaly Detection | Artificial Intelligence | Azure | Bias Mitigation | Cloud ComputingMid-level Full TimeBangalore - Karnataka - India1d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Mid-level Full TimeIndia1d ago
-
Senior-level Full TimeMADURAI, TAMIL NADU, India1d ago
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia1d ago
-
Entry-level Full TimeBangalore, Karnataka, India1d ago
-
Platform Engineer INR 1500K-3900KADLS Gen2 | Azure | Azure Databricks | Azure Networking | Azure StorageSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R1d ago
-
Senior Data Engineer | Offshore INR 1500K-2500KCI/CD | DBT | Data Dictionary | Data Quality | Dimensional ModelingSenior-level Full TimeIndia1d ago
-
Senior-level Full TimePune, MH, IN R1d ago
-
Python, Snowflake, AWS-6-9yrs-BLR INR 1500K-2700KAWS | Agile | Continuous integration | Database Development | ETLSenior-level Full TimeIndia1d ago
-
Consultant - Databricks Azure INR 1000K-2700KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India1d ago
-
Assistant Manager - Databricks Azure INR 1500K-2000KADLS | Amazon Kinesis | Apache Kafka | Apache Spark | Azure ADMid-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Consultant - Databricks Azure INR 1500K-2000KADLS | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior/Staff Data Engineer INR 1500K-3000KAgile | Algorithms | Apache Druid | Cassandra | Data StructuresSenior-level Full TimeDelhi NCR1d ago
-
Staff /Sr Staff/ Principal Engineer - Lakehouse INR 3500K-4800KAWS | Apache Flink | Apache Spark | Azure | CassandraSenior-level Full TimeDelhi NCR1d ago
-
Associate Consultant - Databricks AWS INR 1500K-2000KADLS | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India1d ago
-
Consultant - Databricks AWS INR 1500K-2500KAWS Data | AWS Data Pipeline | AWS Glue | AWS Lake | AWS Lake FormationMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Data Engineer INR 1500K-2700KAWS Glue | AWS Kinesis | AWS Lake | AWS Lake Formation | AWS LambdaSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AWS | Ansible | As-a-Service | Azure | BIOSSenior-level Contract Full TimeIndia - Remote R1d ago
-
Developer II INR 2000K-5000KAWS EKS | Data Structures | Data Structures and Algorithms | Docker | FlaskSenior-level Full TimeBengaluru, KA, India1d ago
-
Lead Software Engineer INR 1500K-3000KAWS Cloud | Apache Airflow | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeBangalore, India1d ago
-
Data Engineer II INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeHyderabad, TG, IN1d ago
-
Business Intelligence Analyst - I INR 1500K-2700KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | DBTSenior-level Full TimeHyderabad, IN, 500 0081d ago