Bigdata Engineer -Spark
Tasks
- Build analytics services components
- Conduct code reviews and ensure build quality
- Contribute to end-to-end architecture and process flow
- Design and develop ETL on Hadoop
- Ensure scheduling workflows and jobs automation
- Ingest batch data
- Optimize performance and fine tune ETL and Hadoop implementations
- Translate business requirements into reusable designs
Perks/Benefits
Skills/Tech-stack
Agile | Apache Cassandra | Apache Hadoop | Apache Hive | Apache Spark | Apache YARN | Avro | Data Lake | Data Warehousing | Elasticsearch | HBase | HDFS | Impala | MapReduce | MongoDB | Parquet | SDLC | SQL | Shell Scripting | Sqoop | Tivoli
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Hadoop Engineer
Related jobs
-
Senior AI Engineer CAD 120K-160KAWS Lambda | Agile | Amazon EC2 | Amazon RDS | Amazon S3Dental insurance coverage | Health insurance coverage | Hybrid work model | Learning and development resources | Vision insurance coverageSenior-level Full TimeToronto, Ontario R10h ago
-
Senior-level ContractMexico, Remote R11h ago
-
Senior-level ContractUSA, Remote R11h ago
-
Lead Data Engineer USD 316K-506KBig Data | Continuous Delivery | Data Architecture | Data Engineering | Data GovernanceFlexible work arrangements | Learning and development programs | Mentoring and coaching | Remote workSenior-level Full TimeChicago, Illinois, USA R13h ago
-
Lead Data Engineer CAD 150K-241KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakeLearning and development programs | Mentoring | Remote workSenior-level Full TimeToronto, Canada R13h ago
-
Lead Data Engineer - Refer USD 316K-506KBig Data | Continuous Delivery | Data Architecture | Data Engineering | Data GovernanceLearning and development programs | Remote workSenior-level Full TimeChicago, Illinois, USA R13h ago
-
Staff Data Engineer, Platform Engineering USD 190K-230KApache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeRemote - United States R16h ago
-
Machine Learning PhD Intern, Economics USD 84K-100KCausal Inference | Keras | Machine Learning | Pandas | PythonFlexible work arrangements | In-person events | Remote workEntry-level InternshipUnited States - Remote R16h ago
-
Data Engineer (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Pipelines401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Health insuranceMid-level Full TimeWork From Home, United States R16h ago
-
Staff Data Engineer USD 180K-180KA/B | A/B Testing | Analytical modeling | Analytics engineering | B testingSenior-level Full TimeRemote R16h ago
-
Data Analyst/BI Engineer USD 85K-110KAPI | Amazon S3 | Apps Script | Azure | BigQuery401k match | Healthcare Dental Vision | Paid Company Holidays | Paid time off | Parental leaveSenior-level Full TimeUnited States R16h ago
-
Mid-level Full TimeArgentina, Remote R16h ago
-
AI Engineer II - Marketing USD 39K-72KAWS | BERT | CI/CD | Docker | EmbeddingsFull-time employment | Remote workMid-level Full TimeBogota, Colombia R16h ago
-
Mid-level Full TimeMexico, Remote R16h ago
-
AI Engineer II - Marketing USD 39K-72KAWS | BERT | CI/CD | Docker | EmbeddingsFull-time employment | Remote workMid-level Full TimeBrazil, Remote R16h ago
-
Mid-level Full TimeLatin America R16h ago
-
AI Engineering I - Marketing USD 30K-39KAWS | Attention Mechanisms | CI/CD | Distributed Systems | DockerEntry-level Full TimeArgentina, Remote R16h ago
-
AI Engineering I - Marketing USD 30K-39KAWS | Agentic Systems | Attention Mechanisms | CI/CD | Distributed SystemsEntry-level Full TimeBogota, Colombia R16h ago
-
Entry-level Full TimeMexico, Remote R16h ago
-
AI Engineering I - Marketing USD 30K-39KAPI Development | AWS | Attention Mechanisms | CI/CD | Data ModelingFull-time employment | Remote workEntry-level Full TimeBrazil, Remote R16h ago
-
Entry-level Full TimeLatin America R16h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS | Amazon CloudWatch | Amazon SageMaker | Apache Spark | Artificial IntelligenceFull-time employment | Remote workSenior-level Full TimeArgentina, Remote R16h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS | AWS CloudWatch | Amazon SageMaker | Apache Spark | CI/CDFull-time employment | Remote workSenior-level Full TimeBogota, Colombia R16h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS CloudWatch | AWS SageMaker | Apache Spark | CI/CD | Credit RiskSenior-level Full TimeMexico, Remote R16h ago
-
Staff Software Engineer, Applied AI (Forward Deployed) USD 209K-307KAI Agents | AWS | Cloud platform | Data Processing | Data Processing PipelinesHybrid work environment | Onsite client collaborationSenior-level Full TimeNew York - Hybrid R17h ago