BigData PySpark Consultant
Tasks
- Apply architecture and testing best practices
- Build and deploy data pipelines
- Communicate project status and risks
- Deploy Hadoop solutions
- Design data solutions
- Develop Hive queries
- Develop and deploy ETL workflows
- Ensure on-time delivery of high-quality code
- Execute software development life cycle
- Research and recommend technology improvements
- Write Spark SQL jobs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Spark | HiveQL | PySpark | Spark SQL | Unix
Education
N/A
Roles
Related jobs
-
AI Engineer, Advanced Solutions Lab, Google Cloud USD 152K-222KApache Beam | Apache Hive | Artificial Intelligence | C++ | Cloud ComputingSenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA5h ago
-
AWS Data Engineering Advisor USD 117K-179KAWS | AWS Batch | AWS Glue | AWS Secrets | AWS Secrets Manager401k retirement savings plan | ESPP | Employer-paid disability insurance | Health, dental, and vision insurance | HolidaysSenior-level Full TimeHOUSTON, US, 770568h ago
-
Senior-level Full TimeUnited States, Washington, Redmond17h ago
-
Principal Engineer - Data Platform USD 221K-387KAccess Control | Apache Spark | Audit Logging | CDC | CompactionSenior-level Full TimeSanta Clara, California, United States R17h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeUnited States18h ago
-
Assistant Manager USD 92K-120KAWS Glue | Airflow | Apache Spark | Azure Data | Azure Data FactoryCareer growth | Hands on experience with modern data technologies | Hybrid workMid-level Full TimeUnited States20h ago
-
Senior-level Full TimeDeerfield, IL, United States R20h ago
-
Full Stack Computer Scientist (Senior-Level) USD 82K-138K.Net Core | Agile | C# | CI/CD | Configuration ManagementCertification reimbursement | Dental insurance | Life insurance | Long-term disability insurance | Medical insuranceSenior-level Full TimeSierra Vista, AZ, United States22h ago
-
Senior Data Engineer - Databricks USD 180K-247KAWS | Access Control | Apache Spark | Azure | CI/CD401k match | Career development program | Corporate Benefit Program | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeDenver, CO R22h ago
-
Mid-level Full TimeUnited States22h ago
-
AWS | Airflow | Apache Flink | Apache Spark | Cloud infrastructureCompetitive pay | Growth opportunities | Remote work | US only work authorizationMid-level Full TimeColumbia - Maryland23h ago
-
AWS | Airflow | Apache Spark | CI/CD | CrawlersCareer growth | Competitive pay | Remote work (US only)Senior-level Full TimeColumbia - Maryland1d ago
-
AWS | Agile | Apache Spark | Azure | Big DataMid-level Full TimeUnited States1d ago
-
Software Engineer I (Data Eng infra) USD 116K-174KAWS | AWS Glue | Amazon Kinesis | Amazon Kinesis Data Streams | Amazon RedshiftEntry-level Full TimeMountain View, California1d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Spark | BigQueryHybrid work environmentSenior-level Full TimePittsburgh, Pennsylvania1d ago
-
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions100 percent on siteSenior-level ContractMc Lean, United States1d ago
-
Data Engineer USD 105K-132KAWS | Algorithms | BigQuery | Continuous Deployment | Continuous integrationIn-office collaborationMid-level Full TimeAustin, TX, United States1d ago
-
Mid-level Full TimeMcLean, VA, United States1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code review100 percent remote | Benefits | Career growth potentialMid-level Full TimeUnited States - Remote R1d ago
-
AI Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageMid-level Full TimeUnited States - Remote R1d ago
-
Data Engineer II (AWS, Databricks, AI) USD 126K-208KAWS | Amazon Bedrock | Artificial Intelligence | Data Governance | Data Quality401k match | Health insurance | Paid Holidays | Paid time off | Volunteer rewardsMid-level Full TimeHartford - Tower, United States1d ago
-
Senior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …1d ago