Senior Data Engineer
Tasks
- Build data pipelines
- Build integrations with data sources
- Build scalable cloud data solutions
- Collaborate with cross-functional teams
- Design data solutions
- Develop data models
- Ensure data security and privacy
- Execute data governance initiatives
- Identify and resolve data challenges
- Implement ELT processes
- Implement ETL processes
- Implement automated workflows for data pipelines
- Improve data quality
- Ingest transform and process datasets
- Maintain data dictionaries
- Maintain data pipelines
- Monitor and schedule data pipelines
- Optimize spark job performance
- Participate in sprint planning and estimations
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Apache Airflow | Apache Spark | CCPA | Caching | Cloud Storage | Data Governance | Data Modeling | Data Privacy | Data Quality | Data Security | Data Warehousing | Data integration | Databricks | Databricks Jobs | ELT | ETL | GDPR | Indexing | Job tuning | Partitioning | PySpark | Python | SQL | Spark Job Tuning | SparkSQL | Workflow Orchestration
Education
Roles
Related jobs
-
Data Operation Engineer INR 2040K-3000KAsset bundles | Azure | Cloud platform | Confluence | DBTHybrid work arrangementMid-level Full TimeChennai, Tamil Nadu, India2h ago
-
AWS | Azure | Cloud platform | Deep learning | Generative AIContinuous learning and growth | Fully remote work | Technical excellence and experimentation cultureSenior-level Full TimeIndia R2h ago
-
Senior Data Engineer, Payments INR 3050K-4350KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore, India2h ago
-
AWS | Access Control | Apache Airflow | Azure | CI/CDAutonomy | Career growth | Inclusive culture | Learning and developmentSenior-level Full TimeIndia2h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
Forward Deployed Engineer INR 2000K-3500KAI | APIs | Agent Orchestration | Agent-based | Agent-based AISenior-level Full TimeHyderabad, India6h ago
-
Senior AI Engineer (Agents) INR 2000K-3500KA/B | A/B Testing | Agent Assist | Anthropic | B testingEmployee benefits | Flexible culture | Remote work flexibilitySenior-level Full TimeHyderabad, India6h ago
-
Staff Data Engineer INR 1500K-2400KAI code generation | AWS | AWS Glue | Agentic Frameworks | Apache IcebergSenior-level Full TimeGurugram11h ago
-
Sr Data Engineer II - Salesforce (Hybrid) INR 1500K-2700KAmazon Redshift | Apache Airflow | Boomi | Bulk API | DBTMid-level Full TimeBangalore, INDIA R12h ago
-
Senior Azure Data Engineer INR 3000K-3900KAPI Integration | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia15h ago
-
Artificial Intelligence | ETL | Git | Pandas | PySparkCollaborative team | Personal growth | Technical mentorship | Values-driven cultureEntry-level Full TimeHyderabad, Telangana16h ago
-
CI/CD | DBT | Data Analysis | Data Modeling | Data NormalizationCharity contribution match | Corporate Volunteering Hours | Dental insurance | Employee discounts | Medical insuranceMid-level Full TimeBengaluru, KA, IN16h ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data Ingestion PipelineAsynchronous culture | Career impact | Competitive salary | Inclusive workplace | Remote-friendlyMid-level Full TimeHyderabad, India17h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Career development opportunities | Remote or distributed setting | Supportive management approachMid-level Full TimeChennai, India17h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous work culture | Remote workMid-level Full TimeKochi, India18h ago
-
API Development | Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud ComputingCareer growth opportunities | Collaborative work culture | Flexible work environment | Mentoring opportunitiesMid-level Full TimeIndia18h ago
-
API Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India18h ago
-
API Integration | AWS | Active Directory | Anthropic | Azure Active DirectoryCareer growth opportunities | Continuous learning and professional development | Cross-functional project exposure | Flexible and collaborative environment | Inclusive workplace cultureSenior-level Full TimeIndia18h ago
-
Senior Data Engineer INR 2000K-3000KAI integrations | API Integration | Automation workflows | Azure Data | Azure Data FactoryClient-facing work | Fast-paced environment | Independent ownershipSenior-level Full TimeBangalore North, India19h ago
-
Data Science INR 2000K-3300KAgentic AI | Apache Airflow | CrewAI | Data Architecture | Data PipelinesSenior-level Full TimeIN-MH-Pune19h ago
-
Data Engineer with Airflow INR 1500K-2400KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago