###1、需求
1、intellij idea打開(kāi)多個(gè)項(xiàng)目
2、每個(gè)同學(xué)開(kāi)發(fā)一個(gè)項(xiàng)目，相互之前獨(dú)立不影響
3、通過(guò)一個(gè)入口可以調(diào)用所有項(xiàng)目類、方法、屬性，達(dá)到同時(shí)開(kāi)發(fā)且檢測(cè)代碼
4、dependency只需要寫一份，其余項(xiàng)目不用寫，便可全部依賴
###2、注意事項(xiàng)（非常重要）
6個(gè)坑：
1、<groupid>com.yh.bi</groupid>
項(xiàng)目中所有的groupid要一樣
2、避免循環(huán)依賴，導(dǎo)致程序報(bào)錯(cuò)
3、<scope>provided</scope>
打包的服務(wù)器運(yùn)行時(shí)候需要provided，本機(jī)調(diào)試的時(shí)候，需要注釋
在一個(gè)maven項(xiàng)目中，如果存在編譯需要而發(fā)布不需要的jar包，可以用scope標(biāo)簽，值設(shè)為provided
4、項(xiàng)目、module建好之后需要添加scala的框架支持
5、在yhproject中，可以統(tǒng)一對(duì)所有的module進(jìn)行清理、編譯、打包
6、要運(yùn)行依賴中的module，則必須要將module中的jar包，打到maven中，需要使用install
下面，是我將所有module中的jar打到maven中的路徑：
###3、建立project和建立module
1、只需要建立一個(gè)項(xiàng)目，其他項(xiàng)目由module建立，所有module且放在項(xiàng)目中。
2、本文項(xiàng)目為yhproject，其余都為module，分別是：mainentrance、yhutils、yhapp、yhweb、yhgame
項(xiàng)目建立步鄹：
module建立步鄹：
項(xiàng)目、所有module、部分module代碼展示：
###4、項(xiàng)目之前的依賴關(guān)系
###5、代碼展示
mainentrance
package com.yh.bi.dag
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
|
package com.yh.bi.dag/** * created by yuhui on 2017/2/10. */import java.time.{duration, localdate}import com.yh.bi._import com.yh.bi.{userapp, usergame, userweb}import org.slf4j.loggerfactoryimport scala.collection.immutable.{listmap, listset}/** * created by yuhui on 2016/8/25. * task --> node --> dag --> dagexecutor */case class node[t](task: t, parent: t*) { override def tostring: string = { s"$task(${parent.mkstring(",")})" }}case class dag[t](nodes: node[t]*)case class dagexecutor[t](dag: dag[t]) { private val log = loggerfactory.getlogger(this.getclass) private val _nodes: map[t, seq[t]] = dag.nodes.map(node => (node.task, node.parent.filter(_ != null))).tomap private var _pending: set[t] = listset() private var _fails = listmap[t, string]() private var _success = seq[t]() //判斷node的task節(jié)點(diǎn)的父節(jié)點(diǎn)運(yùn)行狀態(tài)（flase ，true） private def getpending: option[t] = { _pending.find { name => val parents = _nodes(name) !parents.exists(name => !_success.contains(name)) } } private def fail(name: t, message: string): unit = { _pending -= name _fails += name -> message for (child <- _pending.filter(child => _nodes(child).contains(name))) { fail(child, s"依賴的任務(wù)無(wú)法執(zhí)行: $name") } } private def success(name: t): unit = { _pending -= name _success = _success :+ name } def execute(func: t => unit): unit = { _pending = _nodes.keyset _fails = listmap() _success = seq() var running = true while (running) { val taskopt = getpending if (taskopt.nonempty) { val task = taskopt.get val startmills = system.currenttimemillis() log.info("start task {}", task) try { println("=============") func(task) //執(zhí)行executor方法 println("+++++++++++++") val time = duration.ofmillis(system.currenttimemillis() - startmills) log.info(s"end task $task time=$time") success(task) } catch { case e: throwable => fail(task, e.getmessage) log.error(e.getmessage, e) log.info(s"fail task $task") } } else { running = false } } for (name <- _success) { log.info(s"success task: $name") } for (name <- _fails) { log.info(s"fail task: ${name._1} - ${name._2}") } }}object dag { val allsdkdag = new dag[task]( node(userapp), node(usergame), node(userweb) ) def main(args: array[string]): unit = { dagexecutor(allsdkdag).execute { task =>task.executor("appkey": string, localdate.now(), localdate.now())} }} |
yhutils
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
|
package com.yh.bi/** * created by yuhui on 2017/2/10. */import java.time.localdateimport org.apache.spark.sql.sqlcontextimport org.slf4j.loggerfactoryabstract class executor extends task with sqlcontextaware { override def run(appkey: string, startday: localdate, endday: localdate)={}}trait sqlcontextaware { implicit var ctx: sqlcontext = _}abstract class task { protected val log = loggerfactory.getlogger(this.getclass) def executor(appkey: string, startday: localdate, endday: localdate): unit def run(appkey: string, startday: localdate, endday: localdate): unit = { executor(appkey, startday, endday) }} |
yhapp
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
|
package com.yh.bi/** * created by yuhui on 2017/2/10. */import java.time.localdateobject userapp extends executor{ override def executor(appkey: string, startday: localdate, endday: localdate): unit = { println("++++我的userapp的執(zhí)行過(guò)程++++") }} |
yhweb
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
package com.yh.biimport java.time.localdateobject userweb extends executor{ override def executor(appkey: string, startday: localdate, endday: localdate): unit = { println("++++我的userweb的執(zhí)行過(guò)程++++") }} |
yhgame
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
|
package com.yh.bi/** * created by yuhui on 2017/2/10. */import java.time.localdateobject usergame extends executor{ override def executor(appkey: string, startday: localdate, endday: localdate): unit = { println("++++我的usergame的執(zhí)行過(guò)程++++") }} |
###6、項(xiàng)目中pom依賴展示
yhproject中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhproject</artifactid> <packaging>pom</packaging> <version>1.0</version> <modules> <module>mainentrance</module> <module>yhapp</module> <module>yhweb</module> <module>yhgame</module> <module>yhutils</module> </modules></project> |
mainentrance中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <artifactid>mainentrance</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope> //本機(jī)調(diào)試則注釋， 集群運(yùn)行則解開(kāi)--> </dependency> <dependency> <artifactid>yhapp</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope>--> </dependency> <dependency> <artifactid>yhgame</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope>--> </dependency> <dependency> <artifactid>yhweb</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope>--> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhutils中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <parent> <artifactid>yhproject</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> </parent> <modelversion>4.0.0</modelversion> <artifactid>yhutils</artifactid> <dependencies> <dependency> <groupid>org.apache.spark</groupid> <artifactid>spark-hive_2.11</artifactid> <version>1.6.1</version> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhapp中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhapp</artifactid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhweb中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhweb</artifactid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhgame中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhgame</artifactid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
###7、運(yùn)行結(jié)果展示
注意：我在mainentrance執(zhí)行dag中的main文件，可以調(diào)用且執(zhí)行了yhutils、yhapp、yhweb、yhgame中的代碼
###8、如果建立java 的module
以上就是本文的全部?jī)?nèi)容，希望對(duì)大家的學(xué)習(xí)有所幫助，也希望大家多多支持服務(wù)器之家。
原文鏈接：https://blog.csdn.net/silentwolfyh/article/details/54970108?utm_source=blogxgwz2
