Job Description
Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters, add and remove nodes using cluster management and monitoring tools like Cloudera Manager, and support performance and scalability requirements, in support of our Data scientist's needs. Some Relational Database administrator experience will also be desirable to support the general administration of Relational Databases.
Design, build, and maintain Big Data workflows/pipelines to process a continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.
Demonstrated work experience in the following with Big Data and distributed programming models and technologies
Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL).
Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines
Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive
Understanding of Map Reduce and other Data Query and Processing and aggregation models
Understanding of challenges of transforming data across distributed clustered environment
Experience with techniques for consuming, holding, and aging out continuous data streams
Ability to provide quick ingestion tools and corresponding access APIs for continuously changing data schema, working closely with Data Engineers around specific transformation and access needs
Preferred:
Experience as a Database administrator (DBA) will be responsible for keeping critical tools database up and running
Building and managing high-availability environments for databases and HDFS systems
Familiarity with transaction recovery techniques and DB Backup
Skills and Attributes:
Ability to have effective working relationships with all functional units of the organization
Excellent written, verbal, and presentation skills
Excellent interpersonal skills
Ability to work as part of a cross-cultural team
Self-starter and Self-motivated
Ability to work without lots of supervision
Works under pressure and is able to manage competing priorities.
Hide
...future leaders. The program provides you with challenging work environments geared toward developing the future financial leaders of Aetna, along-side the support actuarial students need to pass exams and become credentialed actuaries. Each of the four rotations will...
...luxury destination, featuring over 300 rooms, a world\-class spa, a 16,000\-square\-foot rooftop pool deck, 12,000 square feet... ...inside look?_** Take a virtual tour \( \.In this role as a Spa Massage Therapist, you will be responsible for performing and providing professional...
...this job and more exclusive features. Clipbook is hiring a Marketing Lead to drive and scale our content engine. This is a hands-... ...affairs teams. Were used by 200+ of the worlds top PR firms, nonprofits, Fortune 500s, and advocacy groups to surface strategic insights...
Who Are We? Postman is the worlds leading API platform, used by more than 40 million developers and 500,000 organizations, including 98% of the Fortune 500. Postman is helping developers and professionals across the globe build the API-first world by simplifying each step...
...Job Description Vice President, Periodic Control Analyst with BNP Paribas RCC, Inc. in Jersey City, NJ. Create & maintn audit work progrms, incl Audit Guides & Risk & Control Matrices for Capital Mkts activities. Positn reqs a Bach deg (U.S. or For Equiv) in Acctg &...