Grid Computing

Smart Recruiter <[email protected]> Tue, 21 Oct 2008 04:52:56 -0700 (PDT)
Newsgroups gmane.user-groups.linux.delhi.devel
Message-ID <[email protected]>
Hi,
Yahoo! Grid Services is searching 
for qualified Engineers to monitor and maintain our production grid (utility 
computing) clusters. 
Each cluster is thousands of nodes with petabytes of 
high-value data, 
running a distributed file system, map-reduce processing 
framework, 
and scheduling software. These resources are used to drive 
backend 
processing of various Yahoo! services. 

You will be working 
with various Yahoo! teams to deploy their processes 
on the grid and services 
are delivered as per the predetermined SLA . 

The primary computing platform is Hadoop, an Apache Software Foundation 
open source project for massively scalable utility computing. Yahoo! is 
a major contributor to Hadoop and related projects. You will have the 
opportunity to work with a significant open source project that will be 
adopted by some of the largest software and Internet companies in the world. 

The Grid team combines powerful open source packages, including Hadoop, 
a huge quantity of compute and storage resources, petabytes of data from 
a variety of sources, and support services to provide a utility computing 
service platform for the company. 

Responsibilities 

* Based 
on operational and project guidelines, work with independence 
and discretion 
regarding how to carry out tasks. 
* Take initiative to improve processes and 
help to plan for the 
future of the service. 
* Monitor cluster health and 
performance, use critical thinking to 
find areas for improvement. 
* 
Invent better ways to manage the existing clusters, via scripting 
and tools 
development. 
* Hardware and facility capacity planning, provisioning new 
resources. 
* Application profiling and performance analysis. 
* Real-time 
problem diagnosis/resolution on live systems. 
* Data load monitoring. 
* 
Systems monitoring and alerting. 
* Participate in a group pager rotation for 
emergencies for oncall 
support. 
* Devise schemes to transfer terabytes 
of data from diverse locations 
securely and reliably. 
* Reporting (html, 
e-mail, etc). 
* Resolve all operation issues, escalating engineering defects 
to the 
development organization. 
* Documentation on the running systems 
and their associated configurations. 

Minimum Job Qualifications 

* Experience as a Unix systems engineer in managing large installations 
* Strong shell scripting skills in at least one of awk, perl, or python. 
* Strong interpersonal and communication skills; capable of explaining 
simple procedures in writing or verbally; good phone skills. 

Preferred Job Qualifications 

* BS or MS in Computer Science (or 
equivalent). 
* Minimum 3 years experience as a Unix systems engineer 
* 
Knowledge and work experience with Java and Java profilers. 
* Cluster 
computing platforms like Condor, Torque, Maui / Moab , Sun Grid Engine. 
* Experience with programming models for large clusters: 
MPI, PVM, etc.  
 
All 
position will be based @ Yahoo! Bangalore . 
Kindly 
refer some of your friends to make your network 
active.


Please reply back with your updated profile if you are really interested in applying for this position.


Thanks In Advance