Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
G
gic-spark-tag-4.0
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
wangxiaokang
gic-spark-tag-4.0
Commits
e5176cf1
Commit
e5176cf1
authored
Aug 31, 2020
by
guos
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
会员标签4.0
parent
d9baaa45
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
0 deletions
+4
-0
TagFirstConsumptionChannelFilter.java
...om/gic/spark/filter/TagFirstConsumptionChannelFilter.java
+4
-0
No files found.
src/main/java/com/gic/spark/filter/TagFirstConsumptionChannelFilter.java
View file @
e5176cf1
package
com
.
gic
.
spark
.
filter
;
package
com
.
gic
.
spark
.
filter
;
import
com.alibaba.fastjson.JSONObject
;
import
com.gic.spark.datasource.entity.DataSourceEntity
;
import
com.gic.spark.datasource.entity.DataSourceEntity
;
import
com.gic.spark.datasource.mysql.MysqlRddManager
;
import
com.gic.spark.datasource.mysql.MysqlRddManager
;
import
com.gic.spark.entity.bean.TrdVirtualOrderBean
;
import
com.gic.spark.entity.bean.TrdVirtualOrderBean
;
...
@@ -10,6 +11,7 @@ import org.apache.commons.lang.StringUtils;
...
@@ -10,6 +11,7 @@ import org.apache.commons.lang.StringUtils;
import
org.apache.spark.api.java.JavaRDD
;
import
org.apache.spark.api.java.JavaRDD
;
import
org.apache.spark.api.java.Optional
;
import
org.apache.spark.api.java.Optional
;
import
org.apache.spark.sql.Row
;
import
org.apache.spark.sql.Row
;
import
org.json4s.jackson.Json
;
import
scala.Tuple2
;
import
scala.Tuple2
;
import
java.util.ArrayList
;
import
java.util.ArrayList
;
...
@@ -50,6 +52,7 @@ public class TagFirstConsumptionChannelFilter extends AbstractTagConsumRecordFil
...
@@ -50,6 +52,7 @@ public class TagFirstConsumptionChannelFilter extends AbstractTagConsumRecordFil
consumeRecordRDD
=
statisticsTypeHandle
(
orderRdd
,
channelRequest
);
consumeRecordRDD
=
statisticsTypeHandle
(
orderRdd
,
channelRequest
);
System
.
out
.
println
(
"channelRequest==>"
+
JSONObject
.
toJSONString
(
channelRequest
));
JavaRDD
<
Long
>
ecuRdd
=
consumeRecordRDD
.
filter
(
data
->
StringUtils
.
isNotEmpty
(
data
.
getReceipts_time
()))
JavaRDD
<
Long
>
ecuRdd
=
consumeRecordRDD
.
filter
(
data
->
StringUtils
.
isNotEmpty
(
data
.
getReceipts_time
()))
.
mapToPair
(
data
->
Tuple2
.
apply
(
data
.
getEcu_id
(),
data
))
.
mapToPair
(
data
->
Tuple2
.
apply
(
data
.
getEcu_id
(),
data
))
.
reduceByKey
((
x
,
y
)->{
.
reduceByKey
((
x
,
y
)->{
...
@@ -60,6 +63,7 @@ public class TagFirstConsumptionChannelFilter extends AbstractTagConsumRecordFil
...
@@ -60,6 +63,7 @@ public class TagFirstConsumptionChannelFilter extends AbstractTagConsumRecordFil
return
y
;
return
y
;
}
}
}).
filter
(
data
->{
}).
filter
(
data
->{
System
.
out
.
println
(
"data==>"
+
JSONObject
.
toJSONString
(
data
));
if
(
channelRequest
.
getChannelVals
().
contains
(
data
.
_2
().
getOrder_channel_code
())){
if
(
channelRequest
.
getChannelVals
().
contains
(
data
.
_2
().
getOrder_channel_code
())){
return
true
;
return
true
;
}
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment