Advances in optical technologies and techniques for high capacity communications