Big Data Engineer II
Tasks
- Architect and optimize data infrastructure
- Build scalable data pipelines
- Create and maintain dimensional data models
- Design end to end data pipelines for revenue insights
- Develop frameworks and tools to eliminate manual processes
- Ensure security cost efficiency and scalability
- Improve data quality and reduce processing latency
- Lead AI driven automation for data processing
- Mentor data engineers
- Translate business requirements into technical solutions
Perks/Benefits
Skills/Tech-stack
AWS Glue | Amazon EMR | Amazon Redshift | Apache Spark | Data Infrastructure | Data Modeling | Data Quality | Data infrastructure optimization | Data pipeline | Data pipeline orchestration | Dimensional Modeling | ELT | ETL | Elastic MapReduce | Infrastructure Optimization | Object-Oriented | Object-oriented programming | Pipeline Orchestration | SQL
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States4h ago
-
Lead Data Engineer USD 114K-160KBusiness Objects | Business Process | Business Process Redesign | Case Development | Compliance AuditingSenior-level Full TimeColumbus, GA, United States4h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA5h ago
-
Senior-level Full TimeJersey City, NJ, United States7h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton8h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton8h ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R8h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA9h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA9h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …9h ago
-
Business Intelligence - Data Engineer 133-2015 USD 80K-115KData Transformation | Data analytics | Data pipeline | Dependency management | ETLMid-level Full TimeTulsa, OK, US12h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935513h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US16h ago
-
PIIM Analytics Engineer USD 105K-160KAI/ML | APIs | Access Control | Azure Databricks | Code AutomationFull time office or project telework | Relocation assistanceMid-level Full TimeHouston, TX, US16h ago
-
Machine Learning Operations Engineer USD 140K-240KAWS | Alerting | Cloud GPU | Compression | Data Quality401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ18h ago
-
Data Analytics Engineer - Techno functional USD 103K-128KAWS | Azure | Business Intelligence | Dashboarding | Data Governance401k | Employee share ownership plan | Flexible work | Healthcare | Paid parental leaveSenior-level Full TimeNew York, US19h ago
-
Staff Data Analytics Engineer USD 159K-220KApache Airflow | Apache Spark | BigQuery | DBT | Data ContractsFlexible working hours | Remote work flexibilitySenior-level Full TimeAmericas - Remote, US - Remote, … R20h ago
-
AI workflows | APIs | Artificial Intelligence | Data Infrastructure | Distributed SystemsDirect collaboration with executive leadership | High impact ownership | Rapid Career Growth Opportunities | Remote-first environment | Visa sponsorshipMid-level Full TimeSan Francisco, California, CA, United States R21h ago
-
Data Engineer USD 120K-160KAmazon Web Services | Azure | C# | Continuous Delivery | Continuous integration401k | Flexible spending | Flexible work options | Health benefits | Leadership opportunitiesMid-level Full TimeUS - NY - Home Office, …21h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeUnited States21h ago
-
Staff Engineer, Data Analysis (R5290) USD 121K-197KAnomaly Detection | Automated Validation | Cloud Storage | Communications | DashboardsSenior-level Full TimeUnited States22h ago
-
Mid-level Full TimeMountain View, CA22h ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States22h ago