Expert Software Engineer, Data Platform
Bangalore - India
R
INR 3242K-4580K (estimate) Senior-level Full Time
Tasks
- Build RESTful APIs and event-driven services
- Build automated validation frameworks
- Build data platform ingestion transformation serving
- Build deploy solutions on cloud
- Champion unit tests for data and service layers
- Conduct code reviews
- Design data platform APIs
- Design scalable data pipelines
- Develop microservices for curated datasets
- Drive CI/CD practices
- Ensure low latency high availability data serving
- Implement data quality observability lineage
- Implement end to end observability metrics logging tracing
- Implement event streaming real time pipelines
- Integrate with upstream/downstream systems
- Mentor engineers on distributed systems Spark optimization API design
- Optimize Spark jobs performance cost reliability
- Take end to end ownership design through support
- Translate business problems into scalable data solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Parquet | Apache Spark | Avro | Azure | CI/CD | Dagster | Data Contracts | Delta Lake | Docker | ELT | ETL | Event Hubs | GCP | Hudi | Iceberg | Java | Kafka | Kubernetes | Lakehouse | Logging | Metrics | Microservices | ORC | PySpark | Python | REST | Scala | Schema evolution | Tracing | Unit Testing
Education
N/A
Related jobs
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R13h ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R16h ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2600KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R16h ago
-
Mid-level Full TimeBengaluru East, Karnataka, India R22h ago
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R1d ago
-
Data Engineer II INR 1000K-1000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesEmployee assistance program | Hybrid work environment | Learning stipend | Medical coverage | Role-specific trainingMid-level Full TimeMumbai R1d ago
-
Staff Engineer, Generative AI Engineer INR 2000K-5000KAI Evaluation | AI Governance | AI Security | AWS Bedrock | Argo CDSenior-level Full TimeRemote, India R1d ago
-
API Design | Apache Airflow | Apache Beam | Apache Flink | Async messagingContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior Data Engineer INR 3600K-5400KAPI Development | AWS | Apache Airflow | Automation | AzureDiscretionary bonus scheme | Family-friendly leave | Flexible working | Hybrid working | Life assuranceSenior-level Full TimeDelhi R1d ago
-
Automated testing | Backend APIs | CI/CD | Cloud infrastructure | Cost OptimizationCross-functional collaboration | Foundational ownership | High autonomy | Remote workMid-level Full TimeIndia R1d ago
-
Mid-level Full TimeNoida R1d ago
-
Software Engineer 2 INR 1500K-2500KAPI Design | AWS | Asynchronous Communication | Data Structures | Distributed SystemsMid-level Full TimeHybrid - Bangalore, India R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Managed Airflow | Airflow | Apache Spark | AzureMedical insurance | Remote-first workplace | Term Life and Personal Accident | Wellness allowanceSenior-level Full TimeIndia - Bangalore R1d ago
-
Mid-level Full TimeBengaluru, KA, IN R1d ago
-
Platform Engineer INR 2500K-5000KAPI Design | Agentic Frameworks | Backend Development | Distributed Systems | Infrastructure as CodeFull autonomy | Remote workSenior-level Full TimeIndia - Remote R1d ago
-
AI Engineer INR 3264K-5876KARM Templates | AWS SNS | AWS SQS | Access Control | Amazon EKSCareer growth | Hybrid work location | Mentorship and coachingSenior-level Full TimeHyderabad (SEZ), India R1d ago
-
AVP, Applied Model Ops Developer (L11) INR 3000K-5000KAWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureFlexible work hours | Regional engagement hubs | Work from homeExecutive-level Full TimeHyderabad IN, India R1d ago
-
Senior Data & AI Engineer INR 2771K-4200KAPI Development | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftSenior-level Full TimeHyderabad, India R1d ago
-
AI Developer INR 2000K-4000KAPI Design | API Gateway | AWS Bedrock | AWS Lambda | Async ProgrammingLearnerbly Learning | Self-development fund | Udemy learningSenior-level Full TimeHyderabad, India R1d ago
-
Analytics Engineer INR 2040K-4000KCI/CD | DBT | Git | GitHub | LookerAsync friendly team | Fully remote | US Pacific Time hoursSenior-level Contract Full TimeIndia Gate, New Delhi, India - … R1d ago
-
Advisor -AI Security Engineer INR 3700K-5000KAI Agent | AI agent security | AI anomaly detection | AWS Security | Access ManagementHybrid work | Work-life flexibilitySenior-level Full TimeBengaluru, India R1d ago
-
Senior Enterprise ETL & Data Warehouse Developer INR 2771K-4000KAccess Control | Azure Data | Azure Data Factory | Azure SQL | Azure SQL DatabaseCareer development learning courses | Disability insurance | Donation matching | Employee assistance program | Employee recognition programSenior-level Full TimeBengaluru, India R1d ago
-
FBS Data Engineer INR 1500K-2000KAgile | DBT | Power BI | PySpark | PythonFlexible work arrangements | Paid time off | Pension plan | Private health insurance | Training and developmentMid-level Full TimeHyderabad, Telangana, India R2d ago
-
Azure Databricks INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksHybrid workMid-level Full TimeBangalore, Karnataka, India R2d ago