摘要

情况1：JSON解析异常
情况2：java.lang.InstantiationException spark.sql.driver
情况3 中kafka：java.lang.NoClassDefFoundError: org/apache/kafka/clients/producer/Callback
情况4 idea启动报错：Connection to node -1 could not be established. Broker may not be available
情况5中kafka： Caused by: java.nio.channels.UnresolvedAddressException master:8080

情况1：JSON解析异常

出错原因：spark命令提交参数json，到另一个jar发现{{或者}}消失了，导致解析异常
解决方案：https://blog.csdn.net/u010814849/article/details/78752074 双括号间+空格

情况2：java.lang.InstantiationException spark.sql.driver

出错原因：spark操作mysql数据库缺少驱动

解决方案：
Properties对象设置props.put(“driver”, “com.mysql.jdbc.Driver”);

情况3：中kafka：java.lang.NoClassDefFoundError: org/apache/kafka/clients/producer/Callback

出错原因：运行期缺少jar包，问题出在maven程序打包没把依赖打进去

解决方案：添加打包插件指定打入依赖jar

<plugin>
    <artifactId>maven-assembly-plugin</artifactId>
    <configuration>
        <descriptorRefs>
            <descriptorRef>jar-with-dependencies</descriptorRef>
        </descriptorRefs>
    </configuration>
    <executions>
        <execution>
            <id>make-assembly</id>
            <phase>package</phase>
            <goals>
                <goal>single</goal>
            </goals>
        </execution>
    </executions>
</plugin>