Senior Big Data Engineer
Tasks
- Architect scalable, low-latency data pipelines
- Build and automate data workflows
- Conduct architectural reviews and technical design sessions
- Design end-to-end data solutions
- Develop ETL and ELT pipelines
- Ensure security and compliance for data solutions
- Evaluate and improve data architecture and processes
- Implement Data Governance and Data Quality
- Monitor data integrity and availability
- Translate business needs into data architecture requirements
Perks/Benefits
Skills/Tech-stack
Alation | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Azure | Collibra | DBT | Data Governance | Data Quality | Databricks | Git | Google Cloud | HBase | Hadoop | Hive | Java | MapReduce | Metadata Management | Oozie | OpenMetadata | Python | Relational databases | Scala | Snowflake | Spark Streaming
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Software Engineer, AI/ML, PhD, Early Career, 2026 INR 4000K-6000KC# | C++ | Data Mining | Data Processing | Data StorageSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior Software Engineer, Core Data Indexing INR 3000K-3800KAI for Personal Productivity | Artificial Intelligence | C++ | Data Processing | Data Processing PipelinesOncall experience | Technical leadership opportunitiesSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior Data Engineer INR 2000K-3000KAWS | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsHealth benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India R6h ago
-
Senior AI Engineer INR 2000K-4500KAI Foundry | AI Search | App Service | Asynchronous programming | AutogenHybrid work model | Mentoring and training opportunitiesSenior-level Full TimeBengaluru, India6h ago
-
Gen AI Developer Associate INR 1800K-4500KAWS Bedrock | Agent to Agent | Azure AI | Cloud platform | DatabricksEntry-level Full TimeIndia6h ago
-
Data Engineer (SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Bricks | Data Factory | ETLEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India7h ago
-
Advanced Data Engineer INR 1500K-3000KAgile | Artificial Intelligence | Cloud services | Data Mapping | Data QualitySenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Mid-level Full TimeNavi Mumbai, IN7h ago
-
Senior-level Full TimeBangalore, KA, IN, 5600767h ago
-
EAI Software Engineer INR 1800K-2500KAPI Gateway | ArgoCD | CI/CD | Cloud Functions | Cloud RunCareer growth | Inclusive work environment | On-site work 4 days a weekMid-level Full TimeHyderabad, India7h ago
-
AI Engineer, FDE (Forward Deployed Engineer) INR 2500K-4200KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureRemote work | Travel once every 4 to 8 weeksSenior-level Full TimeBengaluru, India; Delhi, India; Mumbai, India; … R7h ago
-
Software Engineer (AI/ML) INR 500KAWS | Attention Mechanisms | Azure | Distributed Computing | Domain AdaptationBirthday day off | Career advancement | Employee assistance program | Gratuity | Group personal accident insuranceMid-level Full TimeBengaluru, Onsite7h ago
-
Digital Data Engineer / Plant Specialist Level 2 INR 510K-550KData Modeling | Data Quality | Data Warehousing | ETL | PythonCareer development | Inclusion programs | Multicultural environment | Training opportunitiesEntry-level Full TimePUNE R&D, MH, IN8h ago
-
Associate Consultant_AI/ML Engineer INR 1000K-2000KAI Evaluation | AI Planning | AI Planning and Orchestration | AI Safety | Agent architecturesMid-level Full TimeHyderabad, IN, 5000818h ago
-
Forward Deployed Engineer INR 2000K-3000KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percentSenior-level Full TimeRemote - India R8h ago
-
Machine Learning Engineer INR 2500K-4408KAPIs | Data Pipelines | LLM integration | Language Models | Large Language ModelsEntry-level Full TimeMumbai10h ago
-
IN_RBIN_Assistant Manager/Senior Engineer_Data Scientist INR 1500K-3000KC# | C++ | Data Mining | Decision Trees | Gradient boostingSenior-level Full TimeNashik, Maharashtra, India10h ago
-
Senior Data Engineer (Managed Services) INR 1500K-3000KAutomation | Azure | Azure Data | Azure Data Factory | Azure SynapseCareer growth and progression | Company bonus scheme | Comprehensive benefits package | Hybrid work schedule | Inclusive cultureSenior-level Full TimeHyderabad, Telangana, India R10h ago
-
Technical Lead-Data Engg INR 1500K-2700KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN13h ago
-
Azure Databricks Developer INR 1500K-2500KACID | Access Control | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
Azure Databricks Developer INR 1500K-2500KACID | Access Control | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
Executive - HRIS & Analytics INR 3000K-3300KDashboarding | Data Analysis | Data Quality | Data cleaning | HR AnalyticsExecutive-level Full TimeNoida, IN, 20130713h ago
-
Senior-level Full TimeIN KA - Bangalore, India13h ago
-
Engineers (Agentic / Automation) INR 2475K-4580K.Net Core | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SQSSenior-level Full TimeGurgaon, HR, IN R13h ago
-
Senior Data & AI Engineer INR 3000K-4800KAWS | Airflow | Amazon Bedrock | Annotation Guidelines | CNNSenior-level Full TimeBangalore–Embassy Business Hub, India13h ago