Request for input - Batch processing using JAVA
"Terry Waranch" <[email protected]> Tue, 15 Mar 2011 17:47:07 -0400
| Newsgroups | gmane.org.user-groups.trijug.juglist |
|---|---|
| Message-ID | <1DBAECAF1663DF4B97779F24ABABE24A13B25A4E@RL03EXCH1.replacements.com> |
Hi, I need some input. I have sent this message to another email address but got what I think is a bounce back. If this is a redundant message... sorry! Here goes... Our shop runs a good many batch processes for daily reports, data extracts and data updates. We are moving more toward java as our primary language. Currently we use .jar files for these processes. The programs are developed using Eclipse, exported to .jar files, and uploaded to our Linux server where they are executed. The .jar will run under a Unix shell which is started by Cron. A typical program will run under a minute to all day plus. We use common .jar files for shared code. Performance is good. We have no problem distributing the programs. The thing we don't like about this strategy is that the code is packaged in .jar files which are hard to search and, when necessary, cumbersome to look through. We talked about organizing these processes into web services. We could use Subversion to maintain the library. This would give us a better tool for searching our code and organizing reusable functions. If we did that how would we kill an individual job? I have also read articles that indicate that web servers will kill long running processes. Are people using web services for batch processing. Is that the right tool? As an alternative we talked about using large .jar files. The code for batch processes could be stored in a common .jar file. We could create individual .jar files with a simple MAIN to start a batch process. The jobs would be easy to manage using Cron, easy to kill, and we would be able to use Subversion for library control. How large could a .jar file like this get? Is this the right tool for this kind of processing? If you have any comments or something that I should look at please let me know. I attended a meeting several months ago where Service Oriented Architecture was the topic. Does anyone remember the presenter's name. I would like to address this question to someone who has experience using SOA. Thanks for your help, Terry Terry N. Waranch Business Analyst/Developer REPLACEMENTS, LTD. PO Box 26029 Greensboro, NC 27420-6029 336-697-3000, ext. 2298 Fax: 336-697-3100 [email protected] <mailto:[email protected]> www.replacements.com <http://www.replacements.com/> NOTICE: This message may contain information that is confidential, proprietary, and privileged. If you are not the intended recipient, you may not use, print, copy, disseminate, or retain this message or any information contained in this message, including in any attachments to it. If you have received this message in error, please notify the sender by reply email and delete this message and any attachments to it from your system(s). Thank you for your cooperation. _______________________________________________ Juglist mailing list [email protected] http://trijug.org/mailman/listinfo/juglist_trijug.org