Senior Data Engineer
Tasks
- Architect data pipelines
- Build data modeling frameworks
- Create technical documentation
- Design fault tolerant AWS architectures
- Ensure data quality and lineage
- Establish data engineering best practices
- Implement data ingestion pipelines
- Implement security automation
- Mentor junior engineers
- Optimize data transformation pipelines
- Perform performance profiling and cost optimization
- Set up CI CD for data pipelines
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SQS | Airflow | Amazon Redshift | Auditing | Avro | BigQuery | CI/CD | Caching | Clustering | DBT | Data Modeling | Databricks | Databricks Workflows | Delta Lake | Distributed Computing | Encryption | GitLab | HIPAA | Indexing | Infrastructure as Code | JSON | Kafka | Logging | ORC | Observability | Orchestration | Parquet | Partitioning | PySpark | Python | RBAC | SOC 2 | SQL | Schema evolution | Snowflake | Snowflake Schema | SparkSQL | Star Schema | Terraform | Tokenization | Z-ordering | “as-code”
Education
Bachelor of Engineering | Bachelor of Engineering in Computer Engineering | Bachelor of Science | Bachelor of Science in Computer Science
Roles
Related jobs
-
Algorithms | C++ | Code Refactoring | Code review | Data StructuresExposure to AI development projects | Fast onboarding | Flexible schedule | Part time contractor | Performance-based compensationSenior-level Contract Full TimeIndia R4h ago
-
API Gateway | AWS CloudWatch | AWS Cost Optimization | AWS Glue | AWS LambdaCollaborative environment | Continuing education | Growth opportunities | Professional training opportunities | Remote work flexibilitySenior-level Full TimeIndia4h ago
-
Python With Gen AI INR 1500K-3000KData Analysis | Data Preprocessing | Deep learning | Generative AI | Machine LearningCareer growth programs | Flexible work hours | Remote work | Work-life balanceMid-level Full TimeBangalore, IN8h ago
-
Senior Software Engineer — Python Backend & Data Pipelines INR 3000K-4500KAPI Versioning | Alerting | Authentication | Data Pipelines | DjangoSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Software Engineer - Data Platform INR 3222K-4200KBackend Development | Data Engineering | Data Modeling | Data Pipelines | Dimensional dataCollaborative team environment | Continuous learning culture | Ownership and impactSenior-level Full TimeBangalore13h ago
-
Senior Data Engineer INR 2000K-4000KARM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCross-functional collaboration | Mentorship | Self service analytics enablement | Technical leadershipSenior-level Full TimeBangalore15h ago
-
Mid-level Full TimeIndia16h ago
-
Lead Data Platform Engineer INR 3000K-4000KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS DataZoneEnhanced medical benefits | Family wellbeing benefits | Hybrid work | Paid time off | Wellbeing and safety benefitsSenior-level Full TimeHyderabad, India17h ago
-
Pyspark Bigdata INR 1500K-2500KArchitecture | Big Data | Data Engineering | Data pipeline | Development Life CycleMid-level Full TimeIN-MH-Pune19h ago
-
Sr R&D Engineer (C++, Algorithm, Data Structure) INR 2475K-3500KAlgorithms | C# | C++ | Data Structures | Hardware verificationSenior-level Full TimeBengaluru, India19h ago
-
AWS | Agent Orchestration | Agent memory | Agent observability | Agent planningMid-level Full TimeHinjawadi, MH, India20h ago
-
Cognitive Engineer INR 1500K-3000KAPI Integration | Agent architecture | Application Default Credentials | Asynchronous programming | Automated testingMid-level Full TimeIndia20h ago
-
Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Hyderabad-Vice President INR 3000K-6000KApache Iceberg | Apache Spark | Avro | CI/CD | ContainerizationExecutive-level Full TimeBengaluru, Karnataka, India20h ago
-
Embedded Software Engineer - Delivery INR 2000K-3500KAutomated testing | C# | Code Quality | Coding Standards | Configuration ManagementMid-level Full TimePune, India21h ago
-
Applied AI/ML Senior Associate INR 3799K-5000KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
AI Agents Applied Research/Engineering Lead - Executive Director INR 2500K-5000KA/B | A/B Testing | Adversarial Testing | Agent Orchestration | AuditabilityDiversity and inclusion | Publication opportunities | Research deployment to productionSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
AWS | AWS Lake Formation | AWS Lambda | Airflow | Amazon EMRCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimePune, MH, India22h ago
-
Senior Engineer- Fullstack INR 2475K-5000KAPIs | Analytics | Backend Services | Data Modeling | Data correctnessHybrid work schedule | In person collaboration three days per weekSenior-level Full TimeBangalore, Karnataka, India R22h ago
-
Lead Software Engineer - Java, AWS, React INR 2500K-5000KAWS | Agile | Analysis and Design | Asynchronous Communication | Automated testingSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Senior AI Engineer INR 3264K-5000KAI Services | Access Management | Anomaly Detection | Azure | Azure AISenior-level Full TimeIndia23h ago
-
Cognitive Engineer INR 1500K-3000KAPI Integration | Agent architecture | Application Default Credentials | Asynchronous programming | Automated testingMid-level Full TimeIndia23h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2000K-5000KAPI Development | Cloud platform | Gemini Enterprise | Google ADK | Google CloudClient site work 5 days per weekSenior-level Full TimeBangalore, Karnataka, India23h ago
-
Automated testing | Business Intelligence | CI/CD | Dashboards | Data MartMid-level Full TimeHyderabad, Telangana, India23h ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India1d ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India1d ago