Bigdata Engineer -Spark
Tasks
- Build analytics services components
- Conduct code reviews and ensure build quality
- Contribute to end-to-end architecture and process flow
- Design and develop ETL on Hadoop
- Ensure scheduling workflows and jobs automation
- Ingest batch data
- Optimize performance and fine tune ETL and Hadoop implementations
- Translate business requirements into reusable designs
Perks/Benefits
Skills/Tech-stack
Agile | Apache Cassandra | Apache Hadoop | Apache Hive | Apache Spark | Apache YARN | Avro | Data Lake | Data Warehousing | Elasticsearch | HBase | HDFS | Impala | MapReduce | MongoDB | Parquet | SDLC | SQL | Shell Scripting | Sqoop | Tivoli
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Hadoop Engineer
Related jobs
-
Staff Data Engineer, Platform Engineering USD 190K-230KApache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeRemote - United States R14h ago
-
Machine Learning PhD Intern, Economics USD 84K-100KCausal Inference | Keras | Machine Learning | Pandas | PythonFlexible work arrangements | In-person events | Remote workEntry-level InternshipUnited States - Remote R14h ago
-
Data Engineer (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Pipelines401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Health insuranceMid-level Full TimeWork From Home, United States R14h ago
-
Staff Data Engineer USD 180K-180KA/B | A/B Testing | Analytical modeling | Analytics engineering | B testingSenior-level Full TimeRemote R15h ago
-
Data Analyst/BI Engineer USD 85K-110KAPI | Amazon S3 | Apps Script | Azure | BigQuery401k match | Healthcare Dental Vision | Paid Company Holidays | Paid time off | Parental leaveSenior-level Full TimeUnited States R15h ago
-
Mid-level Full TimeArgentina, Remote R15h ago
-
AI Engineer II - Marketing USD 39K-72KAWS | BERT | CI/CD | Docker | EmbeddingsFull-time employment | Remote workMid-level Full TimeBogota, Colombia R15h ago
-
Mid-level Full TimeMexico, Remote R15h ago
-
AI Engineer II - Marketing USD 39K-72KAWS | BERT | CI/CD | Docker | EmbeddingsFull-time employment | Remote workMid-level Full TimeBrazil, Remote R15h ago
-
Mid-level Full TimeLatin America R15h ago
-
AI Engineering I - Marketing USD 30K-39KAWS | Attention Mechanisms | CI/CD | Distributed Systems | DockerEntry-level Full TimeArgentina, Remote R15h ago
-
AI Engineering I - Marketing USD 30K-39KAWS | Agentic Systems | Attention Mechanisms | CI/CD | Distributed SystemsEntry-level Full TimeBogota, Colombia R15h ago
-
Entry-level Full TimeMexico, Remote R15h ago
-
AI Engineering I - Marketing USD 30K-39KAPI Development | AWS | Attention Mechanisms | CI/CD | Data ModelingFull-time employment | Remote workEntry-level Full TimeBrazil, Remote R15h ago
-
Entry-level Full TimeLatin America R15h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS | Amazon CloudWatch | Amazon SageMaker | Apache Spark | Artificial IntelligenceFull-time employment | Remote workSenior-level Full TimeArgentina, Remote R15h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS | AWS CloudWatch | Amazon SageMaker | Apache Spark | CI/CDFull-time employment | Remote workSenior-level Full TimeBogota, Colombia R15h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS CloudWatch | AWS SageMaker | Apache Spark | CI/CD | Credit RiskSenior-level Full TimeMexico, Remote R15h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS | AWS CloudWatch | Amazon SageMaker | Apache Spark | CI/CDSenior-level Full TimeBrazil, Remote R15h ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS CloudWatch | AWS SageMaker | Apache Spark | CI/CD | Credit RiskFull-time employment | Remote workSenior-level Full TimeLatin America R15h ago
-
Senior Data Engineer USD 129K-164KApache Airflow | Big Data | DBT | Data Cleansing | Data LineageCareer growth | Health coverage | Inclusive culture | Learning opportunities | Modern toolsSenior-level Full TimeRemote R17h ago
-
Data Analytics Engineer USD 167K-200KAWS | Agile | Azure | Blob Storage | CI/CDCloud production exposure | Cross-functional collaboration | Remote positionSenior-level Full TimeRemote R18h ago
-
Data Scientist / Data Engineer / Data Analyst INR 800K-1200KAWS Glue | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkRemote workMid-level Full TimeRemote R18h ago
-
Apache Kafka | Apache Spark | Azure HDInsight | CI/CD | Cloud DataEmployee representative council | Health insurance | Meal vouchers | Profit sharing | Referral bonusSenior-level Full TimeNantes, Pays de la Loire, France R18h ago
-
Software Engineer II (Data Platform) INR 1200K-1600KAlerting | Apache Spark | CI/CD | Data Governance | Data QualityDental insurance | Flexible time off | Medical insurance | Paid parental leave | Remote-first teamsMid-level Full TimeIndia (Remote-First) R22h ago