distributedWekaSpark3Dev - Error trying to start templates
[email protected] Mon, 28 Aug 2023 09:32:53 -0000
| Newsgroups | gmane.comp.ai.weka |
|---|---|
| Message-ID | <169321517332.2673.14575490607986087121@sys-mailman-prd.its.waikato.ac.nz> |
Hello, i have been trying to get weka spark running on my computer but everytime i try to test any templates i get an error saying that the path to weka.jar does not exist (the path to the weka jar file '/home/bald/weka.jar' does not seem to exist!). I have tried every version of WekaDistributedSpark (Spark, SparkDev, SparkDev2, SparkDev3). I also tried it on different OS like ubuntu, debian and windows with the same error everytime. Also tried to manually add a symlink of the weka.jar to the corresponding location. My main OS is arch 6.4.12, i use Weka 3.8.6 and the latest version of the DistributedSpark package (For example: distributedWekaSpark3Dev 1.0.1). Does anyone have an answer to this issues? Thank you Here is the output log : 08:47:42: Weka Knowledge Flow was written by Mark Hall 08:47:42: Weka Knowledge Flow 08:47:42: (c) 2002-2022 The University of Waikato, Hamilton, New Zealand 08:47:42: web: https://www.cs.waikato.ac.nz/~ml/weka/ 08:47:42: Monday, 28 August 2023 08:47:44: [Basic] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|weka.classifiers.mllib.MLlibNaiveBayes will be executed in the single threaded executor 08:47:44: [Low] FlowRunner$2103945938|FlowRunner: Launching start point: ArffLoader 08:47:44: [Basic] ArffLoader$1572457855|Loading weka/gui/knowledgeflow/templates/credit-g.arff 08:47:44: [Basic] ArffLoader$1572457855|Loaded german_credit 08:47:44: [Basic] ClassAssigner$1241966197|Assigned 'class' as class. 08:47:44: [Basic] CrossValidationFoldMaker$462842638|Creating cross-validation folds 08:47:44: [Basic] CrossValidationFoldMaker$462842638|Stratifying data 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 1 out of 10 08:47:44: [Basic] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|Building MLlibNaiveBayes -model-type bernoulli -spark-opts "-master local[*]" on german_credit for fold/set 1 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 3 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 4 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 2 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 5 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 6 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 7 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 4 out of 10 to output 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 8 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 2 out of 10 to output 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 9 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes on german_credit for fold/set 10 out of 10 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 3 out of 10 to output 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 4 for execution 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 6 out of 10 to output 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 2 for execution 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 5 out of 10 to output 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 3 for execution 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 1 out of 10 to output 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 5 for execution 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 9 out of 10 to output 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 6 for execution 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 8 out of 10 to output 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 9 for execution 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 7 out of 10 to output 08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 10 out of 10 to output 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 1 for execution 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 10 for execution 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 7 for execution 08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 8 for execution 08:47:46: [ERROR] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|The path to the weka jar file '/home/bald/weka.jar' does not seem to exist! weka.core.WekaException: The path to the weka jar file '/home/bald/weka.jar' does not seem to exist! at weka.knowledgeflow.steps.Classifier.processIncoming(Classifier.java:389) at weka.knowledgeflow.StepManagerImpl.processIncoming(StepManagerImpl.java:1076) at weka.knowledgeflow.BaseExecutionEnvironment$4.run(BaseExecutionEnvironment.java:475) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: weka.core.WekaException: The path to the weka jar file '/home/bald/weka.jar' does not seem to exist! at weka.knowledgeflow.steps.Classifier.processPrimary(Classifier.java:480) at weka.knowledgeflow.steps.Classifier.processPrimary(Classifier.java:65) at weka.knowledgeflow.steps.PairedDataHelper.processPrimary(PairedDataHelper.java:217) at weka.knowledgeflow.steps.PairedDataHelper.process(PairedDataHelper.java:171) at weka.knowledgeflow.steps.Classifier.processIncoming(Classifier.java:383) ... 7 more Caused by: weka.core.WekaException: The path to the weka jar file '/home/bald/weka.jar' does not seem to exist! at distributed.spark.BaseSparkJobConfig.addWekaLibrariesToSparkContext(BaseSparkJobConfig.java:766) at weka.distributed.spark.SparkJob.addWekaLibrariesToSparkContext(SparkJob.java:240) at weka.distributed.spark.SparkJob.createSparkContextForJob(SparkJob.java:270) at weka.distributed.spark.SparkJob.initJob(SparkJob.java:637) at weka.classifiers.mllib.MLlibClassifier.buildClassifier(MLlibClassifier.java:329) at weka.classifiers.mllib.MLlibNaiveBayes.buildClassifier(MLlibNaiveBayes.java:186) at weka.knowledgeflow.steps.Classifier.processPrimary(Classifier.java:451) ... 11 more 08:47:46: [Low] ArffLoader$1572457855|Interrupted 08:47:46: [Low] ClassAssigner$1241966197|Interrupted 08:47:46: [Low] CrossValidationFoldMaker$462842638|Interrupted 08:47:46: [Low] ClassifierPerformanceEvaluator$505505098|Interrupted 08:47:46: [Low] TextViewer$224428484|Interrupted 08:47:46: [Low] ModelPerformanceChart$1890118483|Interrupted 08:47:46: [Low] ClassifierPerformanceEvaluator2$1511497929|Interrupted 08:47:46: [Low] ClassValuePicker$388202243|Interrupted 08:47:46: [Low] NaiveBayes$1808185841||Interrupted 08:47:46: [Low] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|Interrupted _______________________________________________ Wekalist mailing list -- [email protected] Send posts to [email protected] To unsubscribe send an email to [email protected] To subscribe, unsubscribe, etc., visit https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.ac.nz List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html