Big Data Engineer II
Tasks
- Architect and optimize data infrastructure
- Build scalable data pipelines
- Create and maintain dimensional data models
- Design end to end data pipelines for revenue insights
- Develop frameworks and tools to eliminate manual processes
- Ensure security cost efficiency and scalability
- Improve data quality and reduce processing latency
- Lead AI driven automation for data processing
- Mentor data engineers
- Translate business requirements into technical solutions
Perks/Benefits
Skills/Tech-stack
AWS Glue | Amazon EMR | Amazon Redshift | Apache Spark | Data Infrastructure | Data Modeling | Data Quality | Data infrastructure optimization | Data pipeline | Data pipeline orchestration | Dimensional Modeling | ELT | ETL | Elastic MapReduce | Infrastructure Optimization | Object-Oriented | Object-oriented programming | Pipeline Orchestration | SQL
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States4h ago
-
Lead Data Engineer USD 114K-160KBusiness Objects | Business Process | Business Process Redesign | Case Development | Compliance AuditingSenior-level Full TimeColumbus, GA, United States5h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA6h ago
-
Senior-level Full TimeJersey City, NJ, United States8h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton9h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton9h ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R9h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA10h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA10h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …10h ago
-
Business Intelligence - Data Engineer 133-2015 USD 80K-115KData Transformation | Data analytics | Data pipeline | Dependency management | ETLMid-level Full TimeTulsa, OK, US13h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935514h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US16h ago
-
PIIM Analytics Engineer USD 105K-160KAI/ML | APIs | Access Control | Azure Databricks | Code AutomationFull time office or project telework | Relocation assistanceMid-level Full TimeHouston, TX, US16h ago
-
Machine Learning Operations Engineer USD 140K-240KAWS | Alerting | Cloud GPU | Compression | Data Quality401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ19h ago
-
Data Analytics Engineer - Techno functional USD 103K-128KAWS | Azure | Business Intelligence | Dashboarding | Data Governance401k | Employee share ownership plan | Flexible work | Healthcare | Paid parental leaveSenior-level Full TimeNew York, US19h ago
-
Staff Data Analytics Engineer USD 159K-220KApache Airflow | Apache Spark | BigQuery | DBT | Data ContractsFlexible working hours | Remote work flexibilitySenior-level Full TimeAmericas - Remote, US - Remote, … R20h ago
-
AI workflows | APIs | Artificial Intelligence | Data Infrastructure | Distributed SystemsDirect collaboration with executive leadership | High impact ownership | Rapid Career Growth Opportunities | Remote-first environment | Visa sponsorshipMid-level Full TimeSan Francisco, California, CA, United States R21h ago
-
Data Engineer USD 120K-160KAmazon Web Services | Azure | C# | Continuous Delivery | Continuous integration401k | Flexible spending | Flexible work options | Health benefits | Leadership opportunitiesMid-level Full TimeUS - NY - Home Office, …21h ago
-
Principal AI Engineer USD 140K-150KAI Search | AWS | Amazon Bedrock | Azure | Azure AICommuter benefits | Dental insurance | Flexible workplace arrangements | Health insurance | Learning opportunitiesSenior-level Full TimeDallas, TX, United States21h ago
-
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlexible work policy | Health and wellness benefits | On-site work schedule | Professional development support | Travel opportunitiesSenior-level Full TimeCO11, United States21h ago
-
Apache Spark | Batch Processing | Data Modeling | Data Quality | Data WarehousingSenior-level Full TimeBoston - 10 Fan Pier Blvd, …21h ago
-
Analytics Engineer USD 86K-165KAPI | Agile | Data Cleansing | Data Modeling | Data orchestration401k match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeUS-FL-REMOTE, United States R21h ago