1. check version
  2. Edit the local repository:仓库 (conf/setting.xml) 路径是($MAVEN_HOME/project)
  3. Create Project
    1
    2
    3
    4
    5
    mvn archetype:generate \
    -DgroupId=twitter.bijection.Program \
    -DartifactId=bitcoinProgram \
    -DarchetypeArtifactId=maven-archetype-quickstart \
    -DinteractiveMode=false

Build_Successfully.png

  1. Add some dependency:

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    25
    26
    27
    28
    29
    30
    31
    32
    33
    34
    35
    36
    37
    38
    <dependency>
        <groupId>org.scala-lang</groupId>
        <artifactId>scala-library</artifactId>
        <version>${scala.version}</version>
    </dependency>

    <!-- avro & twitter -->
    <dependency>
        <groupId>org.apache.avro</groupId>
        <artifactId>avro</artifactId>
        <version>1.8.0</version>
    </dependency>

    <dependency>
        <groupId>com.twitter</groupId>
        <artifactId>bijection-avro_2.11</artifactId>
        <version>0.9.6</version>
    </dependency>

    <!-- spark dependencies-->
    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.11</artifactId>
        <version>2.3.0</version>
    </dependency>

    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-streaming-kafka-0-10_2.11</artifactId>
        <version>2.3.0</version>
    </dependency>


    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-streaming_2.11</artifactId>
        <version>2.3.0</version>
    </dependency>

  2. Go and edit the JAVA file:
    Where the HelloWorld Program is:
    cd src/main/java/twitter/bijection/Program/
    Where the test program is:
    cd src/test/java/twitter/bijection/Program/

  3. Build the project:（记得是在你的Project的目录下，也就是有pom.xml的那个文件夹
    image.png

  4. You can find class: (只供你查看，不需要做操作)
    cd /opt/maven/bitcoinProgram/target/classes/twitter/bijection/Program
    you can find App.class

  5. 运行:

    1
    hduser@student59:/opt/maven/bitcoinProgram$ java -cp target/bitcoinProgram-1.0-SNAPSHOT.jar twitter.bijection.Program.App

image.png

或者：

1
2
cd /opt/maven/bitcoinProgram/target/classes/
java twitter.bijection.Program.App

也可以出现HelloWorld的结果

Where you can find the jar file?

/opt/maven/bitcoinProgram/target/ 当你build成功之后，你就能够看到在target文件夹下面有个：bitcoinProgram-1.0-SNAPSHOT.jar 获取之后可以用来以后做Spark-submit

image.png