Big Data Engineer
Tasks
- Build analytics platforms
- Design Big Data processing pipelines
- Ensure reliable performant and cost effective data platforms
- Implement streaming data workflows
- Ingest structured and unstructured data
- Operate Hadoop based data ecosystems
- Transform and analyze massive data volumes
- Troubleshoot debug and document data engineering systems
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Atlas | Apache Hive | Apache Spark | Azure HDInsight | CI/CD | Collibra | Databricks | Delta Lake | Distributed Systems | Flink | HBase | HDFS | Hadoop | Hudi | Iceberg | Infrastructure as Code | Java | Kafka | Kubernetes | Oozie | Python | Python Shell | SQL | Scala | Shell Scripting | Spark Streaming | Sqoop | Trino | “as-code”
Education
Roles
Related jobs
-
Analytics Engineer USD 110K-120KAmazon Redshift | BigQuery | Data Modeling | Data Pipelines | DatabricksCareer progression | Cross-functional collaboration | Equity | Remote-first workMid-level Full TimeRemote, United States R8h ago
-
Telemetry Data Engineer USD 110K-128KAnomaly Detection | Azure Data | Azure Data Explorer | Data Engineering | Data Explorer401k retirement plan | Medical/Dental/VisionMid-level ContractRedmond, Washington, USA R9h ago
-
Automated testing | Build Automation | C++ | CI/CD | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractDallas, Texas, USA R10h ago
-
AWS | AWS EC2 | Automation | Azure | Azure Virtual401k match | ESPP | Family leave programs | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R10h ago
-
Principal, Data Analyst/BI Engineer USD 108K-145KAWS | BigQuery | Cloud platform | Data Governance | Data Modeling401k match | Healthcare Dental Vision | Paid Holidays | Paid time off | Parental leaveSenior-level Full TimeUnited States R10h ago
-
AWS | Azure | CI/CD | Cloud platform | Containers401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R11h ago
-
Staff AI Engineer USD 198K-260KAgentic Workflows | Containerization | Docker | Experiment design | Generative AI401k plan participation | Annual performance bonuses | Company equity grants | Disability insurance | Life insuranceSenior-level Full TimeNew York, New York, United States R11h ago
-
Automated testing | C++ | CI/CD | Embedded Linux | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractTampa, Florida, USA R11h ago
-
Automated testing | C++ | CI/CD | Firmware Build | Firmware Testing401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractAtlanta, Georgia, USA R11h ago
-
Machine Learning Engineer, II - 3D Perception USD 153K-183K3D Perception | BEV Representations | Birds Eye View | C++ | Cloud processing100 percent paid medical dental and vision | 401k employer match | Accidental death and dismemberment insurance | Company holiday office closures | Life insuranceMid-level Full TimeRemote, U.S, Ann Arbor, MI, Fort … R12h ago
-
Software Engineer, AI & Security USD 140K-265KAI Security | AI model | Data Pipelines | Distributed Systems | Golang401k matching | Dental | Education stipend | Healthy lunches | Home office stipendMid-level Full TimeMountain View, CA R13h ago
-
Data Engineer USD 130K-150KAlerting | Apache Spark | Azure | Azure DevOps | CI/CDFree on-site gym | Free parking | Free pet insurance | Hybrid remote work | Medical/Dental/Vision insuranceMid-level Full TimeSeattle, United States R13h ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R14h ago
-
BE CAD Physical Impl and AI Engineer USD 401KAI for Design | AI for Design Optimization | ASIC | Automation | Back End CAD401k match | Dental plan | Educational assistance | Health benefits | Hybrid workSenior-level Full TimeAustin,Texas,United States R16h ago
-
Senior-level Full TimeAnnapolis Junction, United States R16h ago
-
Backend & Data Developer (.NET Core / Cloud) USD 115K-150KAWS | AWS Lambda | Alteryx | Amazon Athena | Amazon RedshiftSenior-level Full TimeCenter, Center District, IL R17h ago
-
Cloud Computing | Deep learning | Language Models | Language Processing | Large Language ModelsAutonomy | Contract flexibility | Remote workSenior-level FreelanceUnited States of America R21h ago
-
Cloud infrastructure | Distributed Systems | GPU | JAX | Machine LearningMid-level Full TimeUnited States R1d ago
-
LLM Application Engineer USD 130K-175KAPIs | Agent Frameworks | Databases | Distributed Systems | EvaluationMid-level Full TimeUnited States R1d ago
-
Analytics Engineer USD 115K-149KAirflow | BI Semantic Layer | CI/CD | DAX | DBT401k plan | Catered lunches | Dental insurance | Medical insurance | Onsite fitness centerSenior-level Full TimeIndianapolis, IN R1d ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Kafka | Automated Ingestion | AzureConference presentations | Hackathons | Mentorship | Remote work | Training programsSenior-level Full TimeUnited States R1d ago
-
Senior AWS Data Engineer USD 153K-207KAPI Integration | AWS Batch | AWS CloudTrail | AWS Glue | AWS LambdaRemote workSenior-level Full TimeMountain View, CA, US R1d ago
-
Senior AWS Data Engineer USD 153K-207KAPI | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsContinuous learning | Flexible work hours | Mentorship | Remote workSenior-level Full TimeAtlanta, GA, US R1d ago
-
Machine Leaning Performance Engineer (Inference) USD 200K-300KC++ | CUBLAS | CUDA | CUDA C | CutlassFitness Events | Free meals | Hybrid work options | Paid time off | Volunteer opportunitiesMid-level Full TimeNew York R1d ago
-
Machine Learning Research Engineer USD 200K-300KAI Agents | API Design | Automation | Dask | Data pipelineHybrid work | Paid time off | Paid wellness expenses | Volunteer opportunities | Workshops and continuous learningMid-level Full TimeNew York R1d ago