Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot set extraJavaOptions #263

Open
reith opened this issue Jan 28, 2018 · 2 comments
Open

Cannot set extraJavaOptions #263

reith opened this issue Jan 28, 2018 · 2 comments

Comments

@reith
Copy link

reith commented Jan 28, 2018

Using dcos spark run I cannot provide more than one jvm option by spark.executor.extraJavaOptions. I tried these:

$ dcos spark run --submit-args='--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions="-XX:+UseG1GC -XX:+PrintFlagsFinal" --class ClassPath LibraryPath'
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args='--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions="-XX:+UseG1GC\ -XX:+PrintFlagsFinal" --class ClassPath LibraryPath'
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args="--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions='-XX:+UseG1GC\ -XX:+PrintFlagsFinal' --class ClassPath LibraryPath"
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args="--conf spark.cores.max=4 --conf 'spark.executor.extraJavaOptions=-XX:+UseG1GC -XX:+PrintFlagsFinal' --class ClassPath LibraryPath"
Error when parsing --submit-args: unknown short flag '-X'

$ dcos spark run --submit-args="--conf spark.cores.max=4 --conf spark.executor.extraJavaOptions=-XX:+UseG1GC --conf spark.executor.extraJavaOptions=-XX:+PrintFlagsFinal --class ClassPath LibraryPath"
Passes only -XX:+PrintFlagsFinal to JVM

Spark CLI version: 0.5.5

@vishnu2kmohan
Copy link

@reith Yes, this a known issue that we are working to address.

@vishnu2kmohan
Copy link

@reith Please let us know if you continue to run into this issue with the latest 2.5.0-2.2.1 release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants