IT Support Specialist 1 (Regional)
Tasks
- Apply performance optimization techniques
- Architect scalable data pipelines
- Build distributed data platforms
- Define work assignments and review deliverables
- Deliver scalable solutions with Agile teams
- Deploy and manage ML models with MLflow
- Develop Batch and Streaming Pipelines
- Ensure data quality security compliance governance
- Implement CI/CD pipelines
- Implement data pipeline workflows
- Implement disaster recovery and backup
- Integrate Databricks with Azure services
- Maintain data models for cloud warehouses
- Mentor data engineers and technical leads
- Optimize ETL/ELT processes
- Provision infrastructure with Terraform
- Recommend adoption of emerging data technologies
- Troubleshoot pipeline and infrastructure issues
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure Machine Learning | Azure Synapse | Backup | CI/CD | Cassandra | Cloud Data | Cloud Data Warehouse | Cloud Native | Cloud Native Architecture | Compliance | Compression | Data Factory | Data Governance | Data Modeling | Data Quality | Data Warehouse | Data Warehousing | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Disaster Recovery | Distributed Systems | ELT | ETL | Indexing | Kafka | MLOps | MLflow | Machine Learning | Partitioning | Python | SQL | Scala | Security | Snowflake | Terraform
Education
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Associate Team Lead, Business Analytics INR 1000K-1350KAirflow | Amazon Web Services | Analytics | Cloud platform | Data EngineeringMid-level Full TimeMumbai, MH, IN3h ago
-
Senior Database Engineer (3+ years, Aurora, Dynamo, Redis) INR 1244K-2200KAmazon Aurora | Amazon Aurora MySQL | Amazon Aurora PostgreSQL | Amazon Web Services | Aurora MySQL24x7 support rotation | Hybrid workSenior-level Full TimeBengaluru, INDIA, India4h ago
-
AI Senior Engineer INR 2520K-4500KAgent Orchestration | Amazon Web Services | Autogen | Azure | Cloud platformSenior-level Full TimePune, MH, IN4h ago
-
Senior-level Full TimePune, Maharashtra, India5h ago
-
Sr. Systems Engineer (3 - 6 years, Kafka, IBM MQ, DevOps, Cloud, Gen AI, Automation) INR 2535K-4000KApache Kafka | KSQLDB | Kafka | Kafka Connect | Kafka StreamsHybrid workSenior-level Full TimeBengaluru, INDIA, India6h ago
-
Mid-level Full TimeBangalore, India; Hyderbad, India6h ago
-
Software Engineer (6months to 2 Years of experience - JAVA/Python Backend, CICD, APIs, GEN AI, Microservices, Cloud) INR 1430K-2000KAgile | Apache Kafka | Automated testing | C++ | CI/CDContinued learning opportunities | MentorshipEntry-level Full TimeBengaluru, INDIA, India7h ago
-
Senior AI Engineer INR 2100K-3380KAuditability | Azure | CI/CD | Cloud Computing | Cloud platformCareer development | Collaborative workspaces | Flexible working arrangements | Learning platform accessSenior-level Full TimeMumbai, MH, India7h ago
-
Teamcenter AI Development Engineer INR 2500K-4225KActive Workspace | BMIDE | ITK | Machine Learning | Manufacturing ProcessSenior-level Full TimePune, MH, India7h ago
-
Lead - Data Platform Engineering INR 2156K-2400KAlerting | Bash | CPU performance | Capacity Planning | Concurrency ControlSenior-level Full TimeChennai, India8h ago
-
Data Engineer INR 1500K-1800KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkGlobal induction program | Talent development programs | Time off for digital disconnect days | Time off for volunteering | Wellbeing programsMid-level Full TimeBengaluru, KA, India9h ago
-
Convolutional Neural Networks | Deep learning | Generative AI | Google Gemini | LLM PromptsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India11h ago
-
API | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India11h ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India11h ago
-
Apache Airflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataSenior-level Full TimeKolkata DN 57, India11h ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | App ServiceSenior-level Full TimeKolkata DN 57, India11h ago
-
IN_Manager_Data Analyst_Data and Analytics_Advisory_Bangalore INR 1500K-2000KApache Airflow | Apache Flink | Azure | Azure DevOps | CI/CDMid-level Full TimeBengaluru Millenia, India11h ago
-
API Integration | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India11h ago
-
Amazon Web Services | Apache Airflow | Apache Databricks | Apache Hadoop | Apache SparkSenior-level Full TimeKolkata DN 57, India11h ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India11h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive workplace culture | MentorshipSenior-level Full TimeBengaluru Millenia, India11h ago
-
Ab Initio | BigQuery | Cloud Composer | Cloud Storage | Cloud platformFlexible work programs | Inclusive workplace culture | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India11h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India11h ago
-
Ab Initio | Apache Dataflow | BigQuery | Cloud Composer | Cloud StorageCompetitive compensation | Flexibility programmes | Hybrid work environment | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India11h ago
-
Azure DevOps | Azure Machine Learning | Data Pipelines | MLOps | Machine LearningFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimePune, India11h ago