Przeglądaj źródła

feat:添加新的分桶文件

zhaohaipeng 9 miesięcy temu
rodzic
commit
89cfda983e

Plik diff jest za duży
+ 9 - 0
src/main/resources/20240718_ad_bucket_688.txt


+ 1 - 1
src/main/scala/com/aliyun/odps/spark/examples/makedata_ad/makedata_ad_33_bucketData_20240718.scala

@@ -24,7 +24,7 @@ object makedata_ad_33_bucketData_20240718 {
 
     val loader = getClass.getClassLoader
 
-    val resourceUrlBucket = loader.getResource("20240704_ad_bucket_351.txt")
+    val resourceUrlBucket = loader.getResource("20240718_ad_bucket_688.txt")
     val buckets =
       if (resourceUrlBucket != null) {
         val buckets = Source.fromURL(resourceUrlBucket).getLines().mkString("\n")

+ 1 - 1
src/main/scala/com/aliyun/odps/spark/zhp/临时记录的脚本-广告

@@ -6,7 +6,7 @@ nohup /opt/apps/SPARK2/spark-2.4.8-hadoop3.2-1.0.8/bin/spark-class2 org.apache.s
 --master yarn --driver-memory 1G --executor-memory 2G --executor-cores 1 --num-executors 16 \
 ./target/spark-examples-1.0.0-SNAPSHOT-shaded.jar \
 tablePart:64 repartition:32 \
-beginStr:2024071200 endStr:2024071408 \
+beginStr:2024071409 endStr:2024071723 \
 savePath:/dw/recommend/model/31_ad_sample_data_v4 \
 table:alg_recsys_ad_sample_all \
 > logs/p31_2024062008.log 2>&1 &

Niektóre pliki nie zostały wyświetlone z powodu dużej ilości zmienionych plików