Big Data Engineer
Tasks
- Apply architecture and testing best practices
- Build data pipelines
- Communicate status and risks to stakeholders
- Deploy Hadoop based solutions
- Design Big Data solutions
- Develop Hive queries
- Develop Spark SQL jobs
- Manage delivery timeline
- Perform software development lifecycle
- Research and recommend technology improvements
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Distributed File System | File System | Hadoop | Hadoop Distributed File System | Hive | SQL | Spark SQL | Unix
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R7d ago
-
Lead Applied AI Engineer II USD 118K-243K.NET | AI Agent | AI agent orchestration | AWS | AWS BedrockSenior-level Full TimeAustin, Texas, United States; Dallas, Texas, …3h ago
-
Analytics and Insights Engineer III USD 113K-188KETL | Microsoft Office | Python | SQLSecret clearanceSenior-level Full TimeArlington/Rosslyn, Virginia, United States3h ago
-
Software Engineer III, AI/ML, Google Security Operations USD 147K-211KC++ | Cloud Platforms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA5h ago
-
C++ | Data Structures | Data Structures and Algorithms | Generative AI | GoSenior-level Full TimeNew York, NY, USA5h ago
-
Customer Engineer, Databases, Google Public Sector USD 152K-222KAnalytic workload | Cloud Native | Cloud Native Architecture | Cloud platform | Data MigrationSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA5h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R12h ago
-
Data Scientist ll - Digital Intelligence USD 140K-170KDatabricks | Experiment analysis | Feature Engineering | Machine Learning | Model EvaluationMid-level Full TimeHybrid - US R13h ago
-
Senior Data Engineer, Platform USD 119K-149KAWS DMS | Access Control | Airflow | Amazon Web Services | CI/CDSenior-level Full TimeRemote - US, United States R16h ago
-
Data Engineer USD 120K-150KAPIs | Access Control | Airbyte | Amazon Redshift | Apache AirflowFully remote | Work independentlyMid-level Full TimeUnited States (Remote) R18h ago
-
Software Engineer III : AI/ML Solutions USD 176K-195KAI Platform | AWS SageMaker | Agile | Airflow | Azure MLSenior-level Full TimePalo Alto, CA, United States19h ago
-
Quality Engineer, Tools and Automation USD 110K-140KAPI Testing | Appium | CI/CD | Database | DockerSenior-level Full TimeSeattle19h ago
-
Staff Data Platform Engineer USD 213K-245KAWS | AWS Lambda | CDK | CI/CD | Code Quality401k match | Catered lunches | Dental insurance | Flexible work schedule | HackathonsSenior-level Full TimeRemote, United States R20h ago
-
Lead Data Scientist, Demand Forecasting USD 160K-192KBayesian Modeling | Data Pipelines | Data Quality | Hierarchical modeling | MLOps401k match | Dental insurance | Income protection | Medical insurance | Paid time offSenior-level Full TimeCharlotte, North Carolina, United States20h ago
-
Mid-level Full TimeLos Angeles, CA, United States; New …20h ago
-
Senior Software Engineer, Data & AI Platform USD 171K-224KApache Spark | Batch Processing | CI/CD | Cloud Native | Data Engineering401k retirement savings plan | Annual cash bonus | Equity grants | Flexible time off | Generous parental leaveSenior-level Full TimeRemote, USA R20h ago
-
Data Engineer USD 180K-235KAccess Control | BigQuery | Data Modeling | Data Warehouse | Data pipeline401k match | Medical, dental & vision coverage | Paid parental leave | Stipends | Unlimited PTOMid-level Full TimeNew York20h ago
-
Staff Machine Learning Engineer USD 118K-136KCI/CD | Data Governance | Data Modeling | Data Pipelines | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R21h ago
-
Customer Data Engineer USD 120K-160KAWS | Command Line | DBT | Dagster | Data ModelingComprehensive benefits package | Flexible-hybrid work | Paid tripsMid-level Full TimeSan Francisco, CA; Austin, TX21h ago
-
Staff+ Software Engineer, Data Infrastructure USD 405K-485KAWS | Airflow | Apache Spark | BigQuery | BigtableSenior-level Full TimeSan Francisco, CA | Seattle, WA23h ago
-
Senior Analytics Engineer USD 115K-193KAirflow | Amazon Athena | Apache Iceberg | BigQuery | CI/CD401k | Dental insurance | Health insurance | Paid time off | Remote work opportunitySenior-level Full TimeRemote (United States | Canada) R23h ago
-
Data Management Developer, Mid USD 90K-120KAPIs | Automation | Cognos | CrowdStrike | CybersecuritySenior-level Full TimeDC Metro Area23h ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States23h ago
-
Machine Learning Engineer, ASE Search Team USD 175K-312KA/B | A/B Testing | Agentic Architectures | Apache Spark | B testingSenior-level Full TimeSeattle1d ago
-
Senior-level Full TimeBoston, Massachusetts, United States1d ago