Which two parameters should you modify?

You use YARN to manage the resources for a Spark Thrift Server running on a Linux-based Apache Spark
cluster in Azure HDInsight.
You discover that the cluster does not fully utilize the resources. You want to increase resource allocation.You need to increase the number of executors and the allocation of memory to the Spark Thrift Server driver.
Which two parameters should you modify? Each correct answer presents part of the solution.
NOTE: Each correct selection is worth one point.

You use YARN to manage the resources for a Spark Thrift Server running on a Linux-based Apache Spark
cluster in Azure HDInsight.
You discover that the cluster does not fully utilize the resources. You want to increase resource allocation.You need to increase the number of executors and the allocation of memory to the Spark Thrift Server driver.
Which two parameters should you modify? Each correct answer presents part of the solution.
NOTE: Each correct selection is worth one point.

A.
spark.dynamicAllocation.maxExecutors

B.
spark.cores.max

C.
spark.executor.memory

D.
spark_thrift_cmd_opts

E.
spark.executor.instances

Explanation:
https://stackoverflow.com/questions/37871194/how-to-tune-spark-executor-number-cores-andexecutor-memory



Leave a Reply 0

Your email address will not be published. Required fields are marked *