Research on Distributed V2V Computation Offloading Method for Internet of Vehicles Blockchain

doi:10.3778/j.issn.1673-9418.2307081

Abstract

Abstract: Vehicle edge computing enhances the computational capabilities of vehicles by offloading computations. The existing task offloading strategies do not simultaneously consider data security, priority of offloading tasks, computation resource release, and incentivizing vehicle to share computation resources, making it difficult to adapt to dynamic vehicle environments. To address these problems, this paper investigates the distributed vehicle-to-vehicle (V2V) computation offloading problem, establishes a Markov decision process, and designs a deep reinforcement learning-based optimal task allocation strategy for computation offloading. This paper utilizes dynamic pricing to incentivize vehicle to share computation resources while considering task priorities and computation resource release mechanisms. Additionally, this paper embeds the offloading scheme into the blockchain, employs the vehicles blockchain with identity authentication mechanisms to encrypt sensitive information such as vehicle information, task information, and transaction information, thus ensuring data security. Simulation experimental results validate the performance of the proposed method. Compared with other algorithms, the average efficiency of the system is improved by at least 9.58% while the training time is saved by 10.28%.

Key words: vehicular edge computing, computation offloading, deep reinforcement learning, blockchain

摘要： 车辆边缘计算是通过车辆间传输计算任务来完成计算卸载，可以提高车辆的计算能力。目前的卸载任务分配策略没有同时考虑数据安全性、卸载任务优先级、计算资源释放和激励车辆共享计算资源，难以适应动态车辆环境。针对以上背景，研究分布式车对车（V2V）计算卸载问题，建立马尔科夫决策过程，设计了基于深度强化学习的计算卸载最优任务分配策略，利用动态定价来激励车辆共享计算资源，考虑卸载任务优先级和计算资源释放机制。将卸载方案嵌入到区块链中，通过建立车联网区块链的身份认证机制，对车辆信息、任务信息、交易信息等敏感信息进行加密处理，满足保障数据安全性的需求。仿真实验结果验证了所提出方法的性能，与其他算法相比，该方法在节省10.28%训练时间的情况下，将系统平均效益至少提高了9.58%。

关键词: 车辆边缘计算, 计算卸载, 深度强化学习, 区块链

MENG Zhen, REN Guanyu, WAN Jianxiong, LI Leixiao. Research on Distributed V2V Computation Offloading Method for Internet of Vehicles Blockchain[J]. Journal of Frontiers of Computer Science and Technology, 2024, 18(7): 1923-1934.

孟珍, 任冠宇, 万剑雄, 李雷孝. 车联网区块链分布式车对车计算卸载方法研究[J]. 计算机科学与探索, 2024, 18(7): 1923-1934.

References

[1] ZHANG X, CHEN X. Data security sharing and storage based on a consortium blockchain in a vehicular ad-hoc network[J]. IEEE Access, 2019, 7: 58241-58254.
[2] YANG R, YU F R, SI P, et al. Integrated blockchain and edge computing systems: a survey, some research issues and challenges[J]. IEEE Communications Surveys & Tutorials, 2019, 21(2): 1508-1532.
[3] VANGALA A, BERA B, SAHA S, et al. Blockchain-enabled certificate-based authentication for vehicle accident detection and notification in intelligent transportation systems[J]. IEEE Sensors Journal, 2021, 21(14): 15824-15838.
[4] ZHANG X D, LI R, CUI B. A security architecture of VANET based on blockchain and mobile edge computing[C]//Proceedings of the 1st IEEE International Conference on Hot Information-Centric Networking, Shenzhen, Aug 15-17, 2018. Piscataway: IEEE, 2018: 258-259.
[5] ZHOU Z, WANG B, DONG M, et al. Secure and efficient vehicle-to-grid energy trading in cyber physical systems: integration of blockchain and edge computing[J]. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 50(1): 43-57.
[6] VOLODYMYR M, KORAY K, DAVID S, et al. Human-level control through deep reinforcement learning[J]. Nature, 2015, 518(7540): 529-533.
[7] TAN L T, HU R Q. Mobility-aware edge caching and computing in vehicle networks: a deep reinforcement learning[J]. IEEE Transactions on Vehicular Technology, 2018, 67(11): 10190-10203.
[8] LIU Y, YU H, XIE S, et al. Deep reinforcement learning for offloading and resource allocation in vehicle edge computing and networks[J]. IEEE Transactions on Vehicular Technology, 2019, 68(11): 11158-11168.
[9] LUO Q, LI C, LUAN T H, et al. Collaborative data scheduling for vehicular edge computing via deep reinforcement learning[J]. IEEE Internet of Things Journal, 2020, 7(10): 9637-9650.
[10] ZHANG K, ZHU Y, LENG S, et al. Deep learning empowered task offloading for mobile edge computing in urban informatics[J]. IEEE Internet of Things Journal, 2019, 6(5): 7635-7647.
[11] TAVAKOLI A, PARDO F, KORMUSHEV P. Action branching architectures for deep reinforcement learning[C]//Proceedings of the 32nd AAAI Conference on Artificial Intelligence, the 30th Innovative Applications of Artificial Intelligence, and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence, New Orleans, Feb 2-7, 2018. Menlo Park: AAAI, 2018: 4131-4138.
[12] SUN Y, GUO X, SONG J, et al. Adaptive learning-based task offloading for vehicular edge computing systems[J]. IEEE Transactions on Vehicular Technology, 2019, 68(4): 3061-3074.
[13] FENG J, LIU Z, WU C, et al. AVE: autonomous vehicular edge computing framework with ACO-based scheduling[J] IEEE Transactions on Vehicular Technology, 2017, 66(12):10660-10675.
[14] SU Z, HUI Y, LUAN T H. Distributed task allocation to enable collaborative autonomous driving with network softwarization[J]. IEEE Journal on Selected Areas in Communications, 2018, 36(10): 2175-2189.
[15] LIWANG M, DAI S, GAO Z, et al. A truthful reverse-auction mechanism for computation offloading in cloud-enabled vehicular network[J]. IEEE Internet of Things Journal, 2019, 6(3): 4214-4227.
[16] SHI J, DU J, WANG J, et al. Priority-aware task offloading in vehicular fog computing based on deep reinforcement learning[J]. IEEE Transactions on Vehicular Technology, 2020, 69(12): 16067-16081.
[17] SHI J, DU J, WANG J, et al. Distributed V2V computation offloading based on dynamic pricing using deep reinforcement learning[C]//Proceedings of the 2020 IEEE Wireless Communications and Networking Conference, Seoul, May 25-28, 2020. Piscataway: IEEE, 2020.
[18] SHI J, DU J, WANG J, et al, DRL-based V2V computation offloading for blockchain-enabled vehicular networks[J]. IEEE Transactions on Mobile Computing, 2023 22(7): 3882-3897.
[19] WANG Z, FREITAS N D, LANCTOT M. Dueling network architectures for deep reinforcement learning[EB/OL].[2023-05-10]. https://arxiv.org/abs/1511.06581.
[20] HASSELT H V, GUEZ A, SILVER D. Deep reinforcement learning with double Q-learning[EB/OL]. [2023-05-10]. https://arxiv.org/abs/1509.06461.
[21] CHEN X, JIAO L, LI W, et al. Efficient multi-user computation offloading for mobile-edge cloud computing[J]. IEEE/ACM Transactions on Networking, 2016, 24(5): 2795-2808.
[22] DU J, GELENBE E, JIANG C, et al. Contract design for traffic offloading and resource allocation in heterogeneous ultra-dense networks[J]. IEEE Journal on Selected Areas in Communications, 2017, 35(11): 2457-2467.
[23] KAYNIA M, JINDAL N. Performance of ALOHA and CSMA in spatially distributed wireless networks[C]//Proceedings of the 2008 IEEE International Conference on Communications, Beijing, May 19-23, 2008. Piscataway: IEEE, 2008: 1108-1112.