distributedWekaSpark3Dev - Error trying to start templates

[email protected] Mon, 28 Aug 2023 09:32:53 -0000
Newsgroups gmane.comp.ai.weka
Message-ID <169321517332.2673.14575490607986087121@sys-mailman-prd.its.waikato.ac.nz>
Hello, i have been trying to get weka spark running on my computer but everytime i try to test any templates i get an error saying that the path to weka.jar does not exist (the path to the weka jar file '/home/bald/weka.jar' does not seem to exist!).  I have tried every version of WekaDistributedSpark (Spark, SparkDev, SparkDev2, SparkDev3). I also tried it on different OS like ubuntu, debian and windows with the same error everytime. Also tried to manually add a symlink of the weka.jar to the corresponding location.

My main OS is arch 6.4.12, i use Weka 3.8.6 and the latest version of the DistributedSpark package (For example: distributedWekaSpark3Dev 1.0.1).
Does anyone have an answer to this issues? 
Thank you

Here is the output log : 
08:47:42: Weka Knowledge Flow was written by Mark Hall
08:47:42: Weka Knowledge Flow
08:47:42: (c) 2002-2022 The University of Waikato, Hamilton, New Zealand
08:47:42: web: https://www.cs.waikato.ac.nz/~ml/weka/
08:47:42: Monday, 28 August 2023
08:47:44: [Basic] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|weka.classifiers.mllib.MLlibNaiveBayes will be executed in the single threaded executor
08:47:44: [Low] FlowRunner$2103945938|FlowRunner: Launching start point: ArffLoader
08:47:44: [Basic] ArffLoader$1572457855|Loading weka/gui/knowledgeflow/templates/credit-g.arff
08:47:44: [Basic] ArffLoader$1572457855|Loaded german_credit
08:47:44: [Basic] ClassAssigner$1241966197|Assigned 'class' as class.
08:47:44: [Basic] CrossValidationFoldMaker$462842638|Creating cross-validation folds
08:47:44: [Basic] CrossValidationFoldMaker$462842638|Stratifying data
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 1 out of 10
08:47:44: [Basic] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|Building MLlibNaiveBayes -model-type bernoulli -spark-opts "-master local[*]" on german_credit for fold/set 1 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 3 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 4 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 2 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 5 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 6 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 7 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 4 out of 10 to output
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 8 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 2 out of 10 to output
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 9 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Building NaiveBayes  on german_credit for fold/set 10 out of 10
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 3 out of 10 to output
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 4 for execution
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 6 out of 10 to output
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 2 for execution
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 5 out of 10 to output
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 3 for execution
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 1 out of 10 to output
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 5 for execution
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 9 out of 10 to output
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 6 for execution
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 8 out of 10 to output
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 9 for execution
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 7 out of 10 to output
08:47:44: [Basic] NaiveBayes$1808185841||Dispatching model for set 10 out of 10 to output
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 1 for execution
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 10 for execution
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 7 for execution
08:47:44: [Basic] ClassifierPerformanceEvaluator2$1511497929|Scheduling evaluation of fold/set 8 for execution
08:47:46: [ERROR] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|The path to the weka jar file '/home/bald/weka.jar' does not seem to exist!
weka.core.WekaException: The path to the weka jar file '/home/bald/weka.jar' does not seem to exist!
	at weka.knowledgeflow.steps.Classifier.processIncoming(Classifier.java:389)
	at weka.knowledgeflow.StepManagerImpl.processIncoming(StepManagerImpl.java:1076)
	at weka.knowledgeflow.BaseExecutionEnvironment$4.run(BaseExecutionEnvironment.java:475)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
	at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.base/java.lang.Thread.run(Unknown Source)
Caused by: weka.core.WekaException: The path to the weka jar file '/home/bald/weka.jar' does not seem to exist!
	at weka.knowledgeflow.steps.Classifier.processPrimary(Classifier.java:480)
	at weka.knowledgeflow.steps.Classifier.processPrimary(Classifier.java:65)
	at weka.knowledgeflow.steps.PairedDataHelper.processPrimary(PairedDataHelper.java:217)
	at weka.knowledgeflow.steps.PairedDataHelper.process(PairedDataHelper.java:171)
	at weka.knowledgeflow.steps.Classifier.processIncoming(Classifier.java:383)
	... 7 more
Caused by: weka.core.WekaException: The path to the weka jar file '/home/bald/weka.jar' does not seem to exist!
	at distributed.spark.BaseSparkJobConfig.addWekaLibrariesToSparkContext(BaseSparkJobConfig.java:766)
	at weka.distributed.spark.SparkJob.addWekaLibrariesToSparkContext(SparkJob.java:240)
	at weka.distributed.spark.SparkJob.createSparkContextForJob(SparkJob.java:270)
	at weka.distributed.spark.SparkJob.initJob(SparkJob.java:637)
	at weka.classifiers.mllib.MLlibClassifier.buildClassifier(MLlibClassifier.java:329)
	at weka.classifiers.mllib.MLlibNaiveBayes.buildClassifier(MLlibNaiveBayes.java:186)
	at weka.knowledgeflow.steps.Classifier.processPrimary(Classifier.java:451)
	... 11 more

08:47:46: [Low] ArffLoader$1572457855|Interrupted
08:47:46: [Low] ClassAssigner$1241966197|Interrupted
08:47:46: [Low] CrossValidationFoldMaker$462842638|Interrupted
08:47:46: [Low] ClassifierPerformanceEvaluator$505505098|Interrupted
08:47:46: [Low] TextViewer$224428484|Interrupted
08:47:46: [Low] ModelPerformanceChart$1890118483|Interrupted
08:47:46: [Low] ClassifierPerformanceEvaluator2$1511497929|Interrupted
08:47:46: [Low] ClassValuePicker$388202243|Interrupted
08:47:46: [Low] NaiveBayes$1808185841||Interrupted
08:47:46: [Low] MLlibNaiveBayes$1737562349|-model-type bernoulli -spark-opts "-master local[*]"|Interrupted
_______________________________________________
Wekalist mailing list -- [email protected]
Send posts to [email protected]
To unsubscribe send an email to [email protected]
To subscribe, unsubscribe, etc., visit https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.ac.nz
List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html