The emerging Federated Edge Learning (FEL) technique has drawn considerable
attention, which not only ensures good machine learning performance but also
solves "data island" problems caused by data privacy concerns. However,
large-scale FEL still faces following crucial challenges: (i) there lacks a
secure and communication-efficient model training scheme for FEL; (2) there is
no scalable and flexible FEL framework for updating local models and global
model sharing (trading) management. To bridge the gaps, we first propose a
blockchain-empowered secure FEL system with a hierarchical blockchain framework
consisting of a main chain and subchains. This framework can achieve scalable
and flexible decentralized FEL by individually manage local model updates or
model sharing records for performance isolation. A Proof-of-Verifying consensus
scheme is then designed to remove low-quality model updates and manage
qualified model updates in a decentralized and secure manner, thereby achieving
secure FEL. To improve communication efficiency of the blockchain-empowered
FEL, a gradient compression scheme is designed to generate sparse but important
gradients to reduce communication overhead without compromising accuracy, and
also further strengthen privacy preservation of training data. The security
analysis and numerical results indicate that the proposed schemes can achieve
secure, scalable, and communication-efficient decentralized FEL.